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PREFACE 


Since  the  middle  of  1980,  approximately  150  academic  and  research  institutions  around  the 
world  have  installed  MINOS/AUGMENTED,  the  predecessor  of  the  present  system.  About  30 
further  installations  exist  in  private  industry.  With  enquiries  continuing  to  arrive  almost  daily,  the 
need  for  a  combined  linear  and  nonlinear  programming  system  is  apparent  in  both  environments. 
To  date,  many  users  have  been  able  to  develop  substantial  nonlinear  models  and  have  come  to 
be  fairly  confident  that  the  Optimal  Solution  message  actually  means  what  it  says.  Certainly, 
other  less  joyful  exit  messages  will  often  have  greeted  eager  eyes.  These  serve  to  emphasize  that 
model  building  remains  an  art,  and  that  nonlinear  programs  can  be  arbitrarily  difficult  to  solve. 
Nevertheless,  the  success  rate  has  been  high,  and  the  positive  response  from  users  with  diverse 
applications  has  inspired  us  to  pursue  further  development. 

MINOS  5.0  is  the  result  of  prolonged  refinements  to  the  same  basic  algorithms  that  were  in 
MINOS/AUGMENTED: 

•  the  simplex  method  (Dantzig,  1947,  1963), 

•  a  quasi-Newton  method  (very  many  authors  from  Davidon,  1959,  onward), 

•  the  reduced-gradient  method  (Wolfe,  1962),  and 

•  a  projected  Lagrangian  method  (Robinson,  1972;  Rosen  and  Kreuser,  1972). 

From  numerous  potential  options,  it  has  been  possible  to  develop  these  particular  algorithms  into 
a  relatively  harmonious  whole.  The  resulting  system  permits  the  solution  of  both  small  and  large 
problems  in  the  four  main  areas  of  smooth  optimization: 

•  linear  programming, 

•  unconstrained  optimization, 

•  linearly  constrained  optimization,  and 

•  nonlinearly  constrained  optimisation. 

In  rare  cases,  the  quasi-Newton  method  may  require  excessive  storage.  We  have  chosen  not  to 
provide  a  nonlinear  conjugate-gradient  method,  or  a  truncated  linear  conjugate-gradient  method, 
for  this  situation.  Instead,  we  retain  the  quasi-Newton  method  throughout,  restricting  it  to  certain 
subspaccs  where  necessary.  (The  strategy  for  altering  the  subspaces  remains  experimental.) 

We  regret  that  other  obvious  algorithms  (such  as  integer  programming,  piece-wise  smooth 
optimization,  the  dual  simplex  method)  arc  still  not  available.  Nor  arc  ranging  procedures  or 
parametric  algorithms.  Sensitivity  analysis  is  still  confined  to  the  usual  interpretation  of  Lagrange 
multipliers. 

As  before,  MINOS  5.0  is  a  stand-alone  system  that  is  intended  for  use  alongside  commercial 
mathematical  programming  systems  whenever  such  facilities  arc  available.  The  systems  should 
complement  each  other. 

To  users  of  MINOS/ AUGMENTED,  the  most  apparent  extensions  arc  a  scaling  option  (for 
linear  constraints  and  variables  only),  and  the  ability  to  estimate  some  or  all  gradients  numerically, 
if  they  arc  not  computed  by  the  user.  On  a  more  mundane  level,  the  names  of  the  user  subroutines 
for  computing  nonlinearitics  have  been  changed  from  CALCFG  and  CALCON  to  FUNOBJ  and  FUNCON, 
and  two  new  parameters  allow  access  to  the  workspace  used  by  MINOS. 

Internally,  one  of  the  major  improvements  has  been  the  development  of  a  new  basis-handling 
package,  which  forms  the  foundation  of  LUSOL  (Gill,  cl  a I.,  1984),  a  set  of  routines  Tor  computing 
and  updating  a  sparse  W  factorization.  This  pnekage  draws  much  from  the  work  of  Reid  (1976, 
1982).  It  replaces  the  P4-bascd  procedures  in  MINOS/ AUGMENTED  (Saunders,  1976)  and  is 
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substantially  more  efficient  on  problems  whose  basis  matrices  arc  not  close  to  triangular.  As 
before,  column  updates  are  performed  by  the  method  of  Bartels  and  Colub  (I960,  1971),  but  the 
implementation  is  more  efficient  and  there  is  no  severe  degradation  arising  from  large  numbers 
of  “spikes”.  We  venture  to  say  that  IAJSOL  is  the  first  truly  stable  basis  package  that  has  been 
implemented  for  production  use. 

A  further  vital  improvement  has  been  the  development  of  two  new  linesearch  procedures 
(Gill,  et  a/.,  1979)  for  finding  a  step  length  with  and  without  the  aid  of  derivatives.  In  particular 
they  cater  for  function  values  that  are  somewhat  “noisy" — a  common  practical  circumstance. 

From  a  software  engineering  viewpoint,  the  source  code  has  been  restructured  to  ease  the 
problems  of  maintenance  and  future  development.  M/NOS  still  stands  for  Modular  In-core 
Nonlinear  Optimization  System,  and  we  have  done  our  best  to  respect  the  implications  of  the 
“M”.  Nevertheless,  MINOS  5.0  remains  a  parameter-driven  system.  It  is  a  speeding  train  on  a 
railroad  that  has  parallel  tracks  and  many  switches  but  few  closed  circuits.  Its  various  modules 
cannot  be  called  upon  in  an  arbitrary  order.  In  fact,  there  arc  80  parameters  that  can  be  set  if 
necessary  -these  are  the  switching  points  along  the  railroad.  Fortunately,  only  a  handful  need 
be  set  for  any  particular  application.  In  most  cases,  the  default  values  are  appropriate  for  large 
and  small  problems  alike. 

For  interactive  users,  a  new  feature  is  the  SUMMARY  file,  which  provides  at  the  terminal 
a  brief  commentary  on  the  progress  of  a  run.  Unfortunately,  a  two-way  conversation  is  not 
possible.  The  only  input  engendered  by  this  feature  is  an  occasional  dive  for  the  Break  key  to 
abort  an  errant  run.  While  rarely  called  upon,  such  a  facility  can  be  crucial  to  the  security  of 
one’s  computer  funds. 

Throughout  the  development  of  MINOS,  we  have  received  a  great  deal  of  assistance  from 
many  kind  people.  Most  especially,  our  thanks  go  to  Philip  Gill,  Walter  Murray  and  Margaret 
Wright,  whose  knowledge  and  advice  have  made  much  of  this  work  possible.  They  are  largely 
responsible  for  the  linesearch  procedures  noted  above  (which  are  as  vital  to  nonlinear  optimization 
as  basis  factors  are  to  linear  programming),  and  they  are  authorities  on  all  of  the  algorithms 
employed  within  MINOS.  Their  patience  has  been  called  upon  continually  as  other  important 
work  at  SOL  cither  languished  or  fell  unfairly  on  their  shoulders. 

Further  to  basis  factors,  we  acknowledge  the  pioneering  work  of  John  Reid  in  implementing 
the  Markowitz-based  LU  factorization  and  the  Bartcls-Golub  update.  The  LUSOL  procedures  in 
MINOS  5.0  owe  much  to  the  ingenuity  embodied  in  his  LA05  package. 

Users  have  naturally  provided  an  essential  guiding  influence.  In  some  cases  they  are  algorithm 
developers  themselves.  At  home,  we  have  had  constant  encouragement  from  George  Dantzig  and 
the  benefit  of  his  modeling  activity  within  SOL,  notably  on  the  energy-economic  model  PILOT. 
We  thank  him  warmly  for  bringing  the  Systems  Optimization  Laboratory  into  existence.  We  also 
thank  Patrick  McAllister,  John  Stone  and  Wesley  Winkler  for  the  feedback  they  have  provided  by 
running  various  versions  of  MINOS  during  their  work  on  PILOT.  (We  note  that  PILOT  has  grown 
to  1500  constraints  and  4000  variables,  and  now  has  a  quadratic  objective.  From  our  perspective, 
it  is  a  nontrivial  test  problem!)  Likewise,  Alan  Manne  has  provided  encouragement  and  assistance 
from  the  beginning.  Two  of  his  nonlinear  economic  models  have  been  invaluable  as  test  problems 
(and  arc  included  on  the  MINOS  distribution  tape).  We  also  thank  him  and  Paul  Preckcl  for  the 
development  of  procedures  for  solving  sequences  of  related  problems  (Prcckel,  1980).  The  main 
ingredients  of  these  procedures  arc  now  an  intcgrnl  part  of  MINOS. 

From  industry,  we  have  received  immense  benefit  from  the  working  relationship  between 
SOL  and  Robert  Burchett  of  the  General  Electric  Company  (Electric  Utility  Systems  Engineering 
Department)  in  Schenectady,  New  York.  Many  algorithmic  and  user-oriented  details  have  resulted 
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from  his  experience  and  from  his  interest  in  the  fine  points  of  optimization.  Three  years  ago  we 
did  not  envisage  that  problems  involving  thousands  of  nonlinear  constraints  would  soon  be  solved 
successfully,  llob  constantly  pushed  test  versions  of  MINOS  to  their  limits,  and  inspired  the 
development  of  techniques  to  extend  those  limits.  We  thank  him  for  his  tireless  contributions. 

We  are  also  grateful  to  Zcnon  Fortuna,  Steven  Gorclick,  Marc  Heilman,  Thomas  McCormick, 
Larry  Nazareth,  Scott  Rogers,  John  Rowsc  and  John  Tomlin  lor  their  helpful  suggestions  and/or 
assistance  in  tracking  down  bugs.  Finally,  we  thank  the  stafT  of  the  Office  of  Technology  Licensing 
and  the  Information  Technology  Services  at  Stanford  University  for  undertaking  the  task  of 
distributing  MINOS. 

Most  of  the  software  development  was  carried  out  at  the  Stanford  Linear  Accelerator  Center 
with  the  aid  of  the  Wylbur  text  editor  and  the  University  of  Waterloo’s  WATFIV  compiler.  This 
User’s  Guide  was  typeset  using  TJipC*,  with  editorial  assistance  from  Philip  Gill  and  Margaret 
Wright. 

Rrucc  Murtagh 
University  of  New  South  Wales 

Michael  Saunders 
Stanford  University 

December,  1983 


*D.  E.  Knulh,  TEX  and  METAFONT,  New  Directions  in  Typesetting,  American  Mathematical  Society  and  Digital 
Prew,  Bedford,  Maaaachuactta  (1979). 
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1.  INTRODUCTION 

MINOS  is  a  Fortran- based  computer  system  designed  to  solve  large-scale  optimization  problems 
expressed  in  the  following  standard  form: 


minimize 

*■* 

F(x)  +  cTx  +  dTy 

(1) 

subject  to 

f{x)  +  Aiy  =  bi, 

(2) 

A3X  +  A$y  —  bi, 

(3) 

1  s  C) s  “■ 

(4) 

where  the  vectors  c,  d,  bit  bi,  l,  u  and  the  matrices  A\,  A<i,  A3  are  constant,  F(x)  is  a  smooth 
scalar  function,  and  f(x)  is  a  vector  of  smooth  functions  (/*(x)}.  Ideally  the  first  derivatives 
(gradients)  of  F(x)  and  f'(x)  should  be  known  and  coded  by  the  user.  (If  only  some  gradients  are 
known,  MINOS  will  estimate  the  missing  ones  using  finite  dilTcrences.) 

The  n\  components  of  x  arc  called  the  nonlinear  variables,  and  the  ri2  components  of  y  are 
the  linear  variables.  Similarly,  the  mi  equations  (2)  are  called  the  nonlinear  constraints,  and  the 
m2  equations  (3)  are  the  linear  constraints.  Equations  (2)  and  (3)  together  are  called  the  general 
constraints.  We  define  m  =  mj  +  m2  and  n  =  nj  + 113. 

The  constraints  (4)  specify  upper  and  lower  bounds  on  all  variables.  These  are  fundamental 
to  many  problem  formulations  and  are  treated  specially  by  the  solution  algorithms  in  MINOS. 
Some  of  the  components  of  l  and  u  may  be  —00  or  +00  if  desired. 

Similar  bounds  may  be  defined  for  the  general  constraints  (2),  (3).  These  constraints  may 
therefore  be  thought  of  as  taking  the  form 


*1  <  /(x)  +  Axy  <  Mt, 


lj  ^  AjX  +  A$y  ^  U2, 

though  for  historical  reasons  the  bounds  arc  specified  in  terms  of  a  right-hand  side  bi  and  a  range 

Mi  —  /». 

In  the  following  sections  we  introduce  some  of  the  terminology  required,  and  give  an  overview 
of  the  algorithms  used  in  MINOS  and  the  main  system  features. 


1.1  Linear  Programming 

If  the  functions  F(x)  and  f(x)  are  absent,  the  problem  becomes  a  linear  program.  Since  there  is 
no  need  to  distinguish  between  linear  and  nonlinear  variables,  we  prefer  to  use  x  rather  than  y. 
It  is  also  convenient  computationally  to  convert  all  general  constraints  into  equalities,  with  the 
only  inequalities  being  simple  bounds  on  the  variables.  Thus,  we  will  write  linear  programs  in 
the  form 

minimize  cTx  subject  to  Ax  +  Is  =  0,  l  <  [  *  )  <  m, 

*«•  W 

where  the  elements  of  x  arc  called  structural  variables  (or  column  variables )  and  s  is  a  set  of  slack 
variables  (called  logical  variables  by  some  authors).  The  bounds  l  and  u  are  suitably  redefined. 


MINOS  solves  linear  programs  using  a  reliable  implementation  of  the  primal  simplex  method 
(Dantzig,  1063).  The  simplex  method  partitions  the  constraints  Ax  +  Is  =  0  into  the  form 

Bxb  -t-  Nxn  =  0, 

where  the  basis  matrix  B  is  square  and  nonsingular.  The  elements  of  xB  and  xN  are  called  the 
basic  and  nonbasic  variables  respectively;  they  are  a  permutation  of  the  elements  of  x  and  s. 
At  any  given  stage,  each  nonbasic  variable  is  equal  to  its  upper  or  lower  bound,  and  the  basic 
variables  take  on  whatever  values  are  needed  to  satisfy  the  general  constraints.  (Clearly  they 
may  be  computed  by  solving  the  linear  equation  Bx0  —  —Nx„.)  It  can  be  shown  that  if  an 
optimal  solution  to  a  linear  program  exists,  then  it  has  this  form.  The  simplex  method  reaches 
such  a  solution  by  performing  a  sequence  of  iterations,  in  which  one  column  of  B  is  replaced  by 
one  column  of  N  (and  vice  versa),  until  no  such  interchange  can  be  found  that  will  reduce  the 
value  of  cTx. 

If  the  components  of  xB  do  not  satisfy  their  upper  and  lower  bounds,  we  say  that  the  current 
point  is  infeasible.  In  this  case,  the  simplex  method  first  aims  to  reduce  the  sum  or  infeasibilities 
to  zero. 

MINOS  maintains  a  sparse  LU  factorization  of  the  basis  matrix  B,  using  a  Markowitz 
ordering  scheme  and  Bartels-Golub  updates,  as  implemented  in  the  LUSOL  package  of  Gill, 
Murray,  Saunders  and  Wright  (1984).  (For  a  description  of  the  concepts  involved,  see  Reid,  1976, 
1982.)  The  basis  factorization  is  central  to  the  efficient  handling  of  sparse  linear  and  nonlinear 
constraints. 

1.2  Nonlinear  Objective 

When  nonlinearities  are  confined  to  the  term  F(x)  in  the  objective  function,  the  problem  is  a 
linearly  constrained  nonlinear  program.  MINOS  solves  such  problems  using  a  reduced-gradient 
algorithm  (Wolfe,  1962)  in  conjunction  with  a  quasi-Newton  algorithm  (Davidon,  1959).  The 
implementation  follows  that  described  in  Murtagh  and  Saunders  (1978). 

In  this  case,  the  constraints  Ax  +  Is  =  0  arc  partitioned  into  the  form 

Bxb  +  Sxa  +  Nxn  —  0, 

where  xa  is  a  set  of  superbasic  variables.  At  a  solution,  the  basic  and  supcrbasic  variables  will 
lie  somewhere  between  their  bounds,  while  the  nonbasic  variables  will  again  be  equal  to  one  of 
their  bounds.  In  broad  terms,  the  number  or  superbasic  variables  (the  number  of  columns  in  S) 
is  a  measure  of  how  nonlinear  the  problem  is.  Let  this  number  be  s.  (The  context  will  always 
distinguish  s  from  the  vector  of  slack  variables.)  In  many  practical  cases  we  have  found  that  a 
remains  reasonably  small,  say  200  or  less,  regardless  of  the  size  or  the  problem. 

In  the  reduced-gradient  algorithm,  xa  is  regarded  as  a  set  of  independent  variables  that  are 
free  to  move  in  any  desirable  direction,  namely  one  that  will  improve  the  value  of  the  objective 
function  (or  reduce  the  sum  of  infeasibilities).  The  basic  variables  can  then  be  adjusted  in  order 
to  continue  satisfying  the  linear  constraints. 

If  it  appears  that  no  improvement  can  be  made  with  the  current  definition  of  B,  S  and  N, 
some  of  the  nonbasic  variables  arc  selected  to  be  added  to  S,  and  the  process  is  repeated  with  an 
increased  value  of  s.  At  all  stages,  if  a  basic  or  superbasic  variable  encounters  one  of  its  bounds, 
that  variable  is  made  nonbasic  and  the  value  of  s  is  reduced  by  one. 

User’s  familiar  with  linear  programs  may  interpret  the  simplex  method  as  being  exactly  the 
above  process,  with  s  oscillating  between  0  and  1.  (Later,  one  step  of  the  simplex  method  or  the 
reduced-gradient  method  will  be  called  a  minor  iteration.) 


1.3  Nonlinear  Constraints 


A  certain  operator  Z  will  frequently  be  useful  for  descriptive  purposes.  In  the  reduced- 
gradient  algorithm  it  takes  the  form 


though  it  is  never  computed  explicitly.  Since  it  has  full  column  rank  and  satisfies  [B  S  N)Z  =  0, 
we  say  that  Z  spans  the  null  space  of  the  constraint  matrix  ( A  I).  Given  an  LU  factorisation 
of  the  basis  matrix  B,  Z  allows  us  to  work  within  a  region  defined  by  the  linear  constraints. 

An  important  part  of  MINOS  is  a  stable  implementation  of  the  quasi-Newton  algorithm 
for  optimizing  the  superbasic  variables.  This  can  achieve  superlinear  convergence  within  each 
relevant  subspace  (defined  by  the  current  B,  S  and  N).  It  obtains  a  search  direction  ps  for  the 
superbasic  variables  by  solving  a  system  of  the  form 

RTRps  =  —ZTg, 

where  g  is  the  gradient  of  F{x),  ZTg  is  the  reduced  gradient,  and  R  is  a  dense  upper  triangular 
matrix  that  is  updated  in  various  ways  in  order  to  approximate  the  reduced  Hessian  according  to 
RtR  ZtH Z,  where  11  is  the  matrix  of  second  derivatives  of  F(x)  (i.e.,  the  Hessian). 

Once  ps  is  available,  the  search  direction  for  all  variables  is  defined  by  p  =  Zps.  A  line 
search  is  then  performed  to  find  an  approximate  solution  to  the  one-dimensional  problem 

minimize  F(x  +  ap)  subject  to  0  <  a  <  amM, 

a 

where  amax  is  determined  by  the  bounds  on  the  variables.  Another  important  part  of  MINOS  is 
the  step-length  procedure  used  in  the  line  search  to  determine  the  step-length  a.  Two  different, 
procedures  are  used,  depending  on  whether  all  gradients  are  known.  (See  Gill,  Murray,  Saunders 
and  Wright,  1979.)  Interested  users  can  influence  the  amount  of  work  involved  by  setting  a 
parameter  called  the  LINESEARCH  TOLERANCE. 

Normally,  the  objective  function  F(x)  will  never  be  evaluated  at  a  point  x  unless  that  point 
is  feasible,  i.e.,  it  satisfies  the  linear  constraints  and  the  bounds  on  the  variables.  Facilities  are 
provided  to  check  the  calculation  of  gradient  elements,  and  normally  the  check  is  performed  at 
the  first  feasible  point.  However,  users  may  request  that  the  check  be  performed  at  the  very 
beginning  of  a  run,  in  which  case  x  may  not  be  feasible. 

For  details  of  the  matters  mentioned  here  and  many  other  essential  aspects  of  numerical 
optimization,  see  Gill,  Murray  and  Wright  (1981). 

1.3  Nonlinear  Constraint* 

When  the  problem  contains  nonlinear  constraints,  MINOS  uses  a  projected  augmented  Lagrangian 
algorithm,  based  on  a  method  due  to  Robinson  (1972);  see  Murtagh  and  Saunders  (1982).  MINOS 
treats  linear  constraints  and  bounds  specially,  but  the  nonlinear  constraints  may  not  be  satisfied 
until  an  optimal  point  is  reached.  Thus,  /(z)  and  its  gradients  (the  Jacobian  matrix  J(x)  = 
[dp(x)jdxj])  may  need  to  be  defined  outside  the  region  of  interest. 

In  fact,  the  constraint  functions  will  almost  never  be  evaluated  untess  the  linear  constraints 
and  bounds  are  satisfied.  The  principal  exception  is  at  the  very  first  point  zo,  which  may 
optionally  be  specified  by  the  user.  The  vector  /(z)  and  its  Jacobian  will  be  evaluated  at  zo 
regardless  of  Feasibility.  This  matter  must  be  borne  in  mind  during  the  formulation  of  a  nonlinear 
program.  The  main  point  to  remember  is  that  the  nonlinear  constraints  may  be  violated  during 
the  solution  process. 


The  nature  of  the  solution  process  can  be  summarized  as  follows.  A  sequence  of  major 
iterations  is  performed,  each  one  requiring  the  solution  of  a  linearly  constrained  subproblcm. 
The  subproblems  contain  the  original  linear  constraints  and  bounds,  as  well  as  linearized  versions 
of  the  nonlinear  constraints.  This  just  means  that  f(x)  in  equation  (2)  is  replaced  by  Lf ,  its 
linear  approximation  at  the  current  point.  We  shall  write  this  approximation  as 

J(x,  Xk)  =  f{*k)  +  J[xk)(x  -  xk). 

or  more  briefly 

f  =  fk  +  Mx  ~  xk),  (5) 

where  z*  is  the  estimate  of  the  nonlinear  variables  at  the  start  of  the  fc-th  major  iteration.  The 
subproblem  to  be  solved  takes  the  form 


minimize 

*.v 


subject  to 


(») 

f  +  Aiy  =  bi, 

(7) 

A<ix  -f  A3 y  =  62, 

(8) 

(9) 

The  objective  function  (6)  is  called  an  augmented  Lagrangian.  The  vector  X*  is  an  estimate  of  X, 
the  Lagrange  multipliers  for  the  nonlinear  constraints.  The  scalar  p  is  a  penalty  parameter,  and 
the  term  involving  p  is  a  modified  quadratic  penalty  function. 

Using  (5)  we  see  that  the  linear  constraints  (7)  and  (8)  take  the  form 

fJk  V*\  .  (<  «\("'\  _  /'■'**»  -  h\ 


C  :XK  UGH 


MINOS  uses  the  reduced-gradient  algorithm  to  minimize  (6)  subject  to  (10),  with  the  original 
bounds  on  x  and  y,  and  suitable  bounds  on  the  slack  variables  sj  and  sj-  The  Jacobian  Jk  is 
treated  as  a  sparse  matrix,  the  same  as  the  matrices  A,-. 

Unfortunately,  there  is  no  guarantee  that  the  algorithm  just  described  will  converge  from 
an  arbitrary  starting  point.  The  concerned  user  can  influence  the  likelihood  of  convergence  in 
several  ways: 

1.  By  specifying  zo  as  carefully  as  possible. 

2.  By  including  sensible  upper  and  lower  bounds  on  all  variables. 

3.  By  specifying  a  PENALTY  PARAMETER  p  that  is  higher  than  the  default  value,  if  the  problem 
is  suspected  of  being  highly  nonlinear. 

4.  By  specifying  a  DAMPING  PARAMETER  that  is  lower  than  the  default  value,  again  if  the  problem 
is  highly  nonlinear. 

In  rare  cases  it  may  be  safe  to  use  X*  =  0  and  p  =  0  for  all  subproblems,  by  specifying  LAGRANGIAN 
=  NO.  However,  convergence  is  much  more  likely  with  the  default  setting,  LAGRANGIAN  =  YES.  The 
initial  estimate  of  the  Lagrange  multipliers  is  then  Xo  =  0,  but  for  later  subproblcms,  X*  is  taken 
to  be  the  Lagrange  multipliers  associated  with  the  (linearized)  nonlinear  constraints  at  the  end 
of  the  previous  major  iteration. 

The  penalty  parameter  is  initially  100.0/mj  by  default,  and  it  is  reduced  in  stages  for  later 
subproblems  when  it  appears  that  the  sequence  {zfc,X*}  is  converging.  In  many  cases  it  is  safe 
to  specify  p  =  0  from  the  beginning,  particularly  if  the  problem  is  only  mildly  nonlinear.  This 
may  improve  the  overall  efficiency. 


1.5  llestrictiona 
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1.4  Problem  Formulation 

In  general,  it  is  worthwhile  expending  considerable  prior  analysis  to  make  the  constraints  com¬ 
pletely  linear  if  at  all  possible.  Sometimes  a  simple  transformation  will  suffice.  For  example,  a 
pipeline  optimization  problem  has  pressure  drop  constraints  of  the  form 


K, 

d4.814 


+ 


k2 

d*ali 


+ 


<  P*T-P 


3 
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where  <f,  are  the  design  variables  (pipe  diameters)  and  the  other  terms  are  constant.  These 
constraints  arc  highly  nonlinear,  but  by  re-defining  the  decision  variables  to  be  Xi  =  l/d*'8M  we 
can  make  the  constraints  linear.  Even  if  the  objective  function  becomes  more  nonlinear  by  such 
a  transformation  (and  this  usually  happens),  the  advantages  of  having  linear  constraints  greatly 
outweigh  this. 

Similarly,  it  is  important  not  to  move  nonlinearities  from  the  objective  function  into  the 
constraints.  Thus,  we  would  not  replace  minimize  F(x)  by 


minimize  z  subject  to  F(x)  —  z  =  0. 


Scaling  is  a  very  important  matter  during  problem  formulation.  A  general  rule  is  to  scale 
both  the  data  and  the  variables  to  be  as  close  to  1.0  as  possible.  In  general  we  suggest  the 
range  1.0  to  10.0.  When  conflicts  arise,  one  should  sacrifice  the  objective  function  in  favor  of  the 
constraints.  Real-world  problems  tend  to  have  a  natural  scaling  within  each  constraint,  as  long 
as  the  variables  arc  expressed  in  consistent  physical  units.  Hence  it  is  often  sufficient  to  apply 
a  scale  factor  to  each  row.  MINOS  has  an  option  to  scale  the  linear  constraints  and  variables 
automatically. 

Finally,  upper  and  lower  bounds  on  the  variables  (and  on  the  constraints)  are  extremely 
useful  for  confining  the  region  over  which  optimization  has  to  be  performed.  If  sensible  values 
arc  known,  they  should  always  be  used.  They  are  also  important  for  avoiding  singularities  in  the 
problem  functions.  For  safety  when  such  singularities  exist,  the  initial  point  xq  discussed  above 
should  lie  within  the  bounds. 


1.6  Restrictions 

MINOS  is  designed  to  find  solutions  that  are  locally  optimal.  The  nonlinear  functions  in  a  problem 
must  be  smooth  (i.c.,  their  first  derivatives  must  exist).  The  functions  need  not  be  separable. 
Integer  restrictions  cannot  be  imposed  directly. 

A  certain  region  is  defined  by  the  linear  constraints  in  a  problem  and  by  the  bounds  on  the 
variables.  If  the  nonlinear  objective  and  constraint  functions  arc  convex  within  this  region,  any 
optimal  solution  obtained  will  be  a  global  optimum.  Otherwise  there  may  be  several  local  optima, 
and  some  of  these  may  not  be  global.  In  such  cases  the  chances  of  finding  a  global  optimum  are 
usually  increased  by  choosing  a  starting  point  that  is  “sufficiently  close",  but  there  is  no  general 
procedure  for  determining  what  “close”  means,  or  for  verifying  that  a  given  local  optimum  is 
indeed  global. 

MINOS  uses  one  large  array  of  main  storage  for  most  of  its  workspace.  The  length  of  this 
array  may  need  to  be  adjusted  to  suit  a  particular  problem,  but  otherwise  the  implementation 
places  no  fixed  limitation  on  the  size  of  a  problem  or  on  its  shape  (many  constraints  and  relatively 
few  variables,  or  vice  versa).  In  general,  the  limiting  factor  will  be  the  amount  of  main  storage 
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available  on  a  particular  machine,  and  the  amount  of  computation  time  that  one’s  budget  can 
stand. 

Some  a  priori  knowledge  of  a  particular  application  will  usually  indicate  whether  the  solution 
procedure  is  likely  to  be  efficient.  An  important  quantity  is  m  =  mj  +  m2,  the  total  number 
of  general  constraints  in  (2)  and  (3).  We  note  that  m  <  100  is  considered  “small”,  m  =  1000 
or  2000  is  “medium”,  and  m  >  5000  would  be  “large”.  On  machines  that  use  16-bit  integers 
(INTEGER*2  on  IBM  and  DEC  VAX  systems),  the  normal  implementation  of  MINOS  requires  that 
m  <  32767. 

The  amount  of  workspace  required  by  MINOS  is  roughly  100m  words,  where  one  “word”  is 
the  relevant  storage  unit  for  the  floating-point  arithmetic  being  used  (REAL*8  on  IBM  and  DEC 
VAX,  REAL  on  Burroughs  and  most  CDC  machines).  On  IBM  and  VAX  systems,  this  means  about 
800m  bytes  for  workspace.  A  further  300K  bytes,  approximately,  are  needed  for  the  program 
itself,  along  with  buffer  space  for  several  files. 

Another  important  quantity  is  n  =  ni  4-  ri2,  the  total  number  of  variables  in  x  and  y.  For 
nonlinear  problems,  if  m  1  and  nj  are  small  compared  to  m  and  n,  the  total  storage  required 
should  not  be  much  greater  than  just  described.  If  n  1  is  “large”  (say  nj  >  200),  the  amount  of 
storage  required  may  or  may  not  be  substantial,  depending  on  whether  F(x)  or  f(x)  are  highly 
nonlinear  or  not. 

In  this  context,  the  efficiency  of  MINOS  depends  on  a,  the  number  of  supcrbasic  variables. 
Recall  that  m  4-  s  variables  lie  between  their  upper  and  lower  bounds,  where  a  is  zero  for  purely 
linear  problems.  We  know  that  a  need  never  be  larger  than  ni  4-  1.  In  practice,  a  is  often  very 
much  less  than  this  upper  limit. 

In  the  quasi- Newton  algorithm,  the  dense  triangular  matrix  R  has  dimension  s  and  requires 
about  words  of  storage.  If  it  seems  likely  that  s  will  be  very  large,  some  aggregation  or 
reformulation  of  the  problem  should  be  considered. 


1.6  Files 


MINOS  operates  primarily  within  central  memory,  and  is  well  suited  to  a  virtual  storage  environ¬ 
ment.  Certain  disk  files  are  accessed  as  follows. 


Input  file 

Status 

Record  Length  (characters) 

READ  file 

see  below 

SPECS  file 

required 

80 

MPS  file 

required 

81 

BASIS  files 

optional 

80 

Output  file 

Status 

Record  Length  (characters) 

SCRATCH  file 

required 

8 

PRINT  file 

required 

129 

SUMMARY  file 

optional 

80 

BASIS  files 

optional 

80 

SOLUTION  file 

optional 

111 

Fixed-length,  blocked  records  may  be  used  in  all  cases,  and  the  files  are  always  accessed  sequen¬ 
tially.  The  logical  record  length  must  be  at  least  that  shown.  For  efficiency,  the  physical  block 
size  should  be  several  hundred  characters  in  most  cases.  Note  that  the  logical  record  length 
for  the  SCRATCH  file  is  unusually  small.  Each  record  will  contain  an  8-character  name  for  a 
constraint  or  variable,  and  there  will  bem  +  n  such  names. 


1.7  Input  Data  Flow 
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Unit  numbers  for  the  READ,  SPECS,  PRINT  and  SCRATCH  files  are  defined  at  compile 
time;  typically  they  will  be  5,  5,  6  and  8,  but  they  may  depend  on  the  installation.  The  remaining 
unit  numbers  are  specified  at  run  time  in  the  SPECS  file. 

Unit  numbers  for  the  READ,  PRINT  and  SUMMARY  files  are  stored  in  the  following  COMMON 
block: 

COMMON  /M1FILE/  IREAD , IPRINT, ISUMM 

It  may  be  convenient  to  reference  these  in  the  user  subroutines  FUNOBJ,  FUNCON  and  MATMOD. 

System  Note:  The  READ  file  is  not  used  explicitly  by  MINOS,  but  its  unit  number  is  used 
to  test  if  a  file  should  be  rewound.  (Thus,  input  files  are  subject  to  a  Fortran  REWIND  as  long  as 
they  are  not  the  same  as  the  READ  file.)  The  PRINT  file  is  used  frequently.  Other  output  files 
are  rewound  if  they  are  not  the  same  as  the  PRINT  file. 


1.7  Input  Data  Flow 

Some  or  all  of  the  following  items  are  supplied  by  the  user: 

•  Subroutine  FUNOBJ 

•  Subroutine  FUNCON 

•  Subroutine  MATMOD 

•  A  SPECS  file 

•  An  MPS  file 

•  A  BASIS  file 

•  Data  read  by  FUNCON  on  its  first  entry 

•  Data  read  by  FUNOBJ  on  its  first  entry 

•  Data  read  by  FUNCON  on  its  last  entry 

•  Data  read  by  FUNOBJ  on  its  last  entry 

The  order  of  the  files  and  data  is  important  if  all  are  stored  in  the  same  input  stream. 

Subroutines  FUNOBJ  and  FUNCON  define  the  nonlinear  objective  and  constraint  functions 
respectively  (if  any);  they  arc  not  needed  if  the  functions  are  purely  linear  and  are  defined  in 
the  MPS  file. 

Subroutine  MATMOD  is  occasionally  needed,  for  applications  involving  a  sequence  of  closely 
related  problems. 

The  SPECS  file  defines  various  run-time  parameters  (ITERATION  LIMIT,  SAVE  FREQUENCY, 
etc.).  Its  file  number  is  defined  at  compile  time.  It  will  normally  be  the  first  data  set  in  the 
system  card  input  stream. 

The  MPS  file  specifics  names  for  the  constraints  and  variables,  and  defines  all  the  linear 
constraints  and  bounds.  It  may  follow  the  SPECS  file  in  the  card  input  stream,  but  will  often 
reside  in  a  file  of  its  own  (as  specified  in  the  SPECS  file).  The  data  format  is  similar  to  that 
used  in  commercial  mathematical  programming  systems  (hence  the  name).  The  format  has  been 
generalized  slightly  for  nonlinear  problems. 

If  desired,  a  BASIS  file  may  be  loaded  at  the  beginning  of  a  run.  This  will  normally  have 
been  saved  at  the  end  of  an  earlier  run.  Three  kinds  of  basis  file  are  available;  they  are  used  to 
restart  the  solution  of  a  problem  that  was  interrupted,  or  to  provide  a  good  starting  point  for 
some  slightly  modified  problem. 


8 


1.8  Multiple  SPECS  Files 

One  or  more  problems  may  be  processed  during  a  run.  The  parameters  for  a  particular  problem 
arc  delimited  by  BEGIN  and  END  in  the  SPECS  file.  While  scanning  for  the  keyword  BEGIN, 
MINOS  recognizes  the  keywords  SKIP  and  ENDRUN.  Thus  in  the  following  example: 

BEGIN  CASE  1 


END  CASE  1 
SKIP  CASE  2 


END  CASE  2 
BEGIN  CASE  3 


END  CASE  3 
ENDRUN 

BEGIN  CASE  4 


END  CASE  4 

only  the  first  and  third  problem  will  be  processed. 


1.9  Internal  Modifications 

A  sequence  of  closely  related  problems  may  be  specified  within  a  single  SPECS  file,  via  the  CYCLE 
parameter;  for  example, 

BEGIN  CYCLING  EXAMPLE 

CYCLE  LIMIT  10 

END  EXAMPLE 

indicates  that  up  to  10  problems  are  to  be  processed.  This  is  intended  for  cases  where  the  solution 
of  one  problem  Pk  is  needed  to  define  the  next  problem  Pk+i • 

The  actual  method  for  defining  the  next  problem  in  a  cycle  depends  on  the  application. 
Sometimes  it  can  be  done  by  changing  the  output  from  the  function  subroutines  FUNOBJ  and/or 
FUNCON.  Alternatively,  the  user  may  provide  a  third  subroutine  MATMOD  to  perform  some  modifi¬ 
cations  to  the  problem  data.  MATMOD  is  called  by  MINOS  at  the  beginning  of  every  cycle  except 
the  first. 

If  necessary,  the  number  of  linear  variables  can  be  increased  when  a  problem  Pk+i  is  defined. 
We  think  of  this  as  adding  new  columns  to  Pk .  The  new  columns  are  not  included  in  the  MPS  file, 
and  their  sparsity  pattern  need  not  be  known  until  Pk  has  been  solved.  Instead,  an  appropriate 
number  of  PHANTOM  COLUMNS  and  PHANTOM  ELEMENTS  are  defined  in  the  SPECS  file  (to  reserve 
a  pool  of  storage),  and  the  user's  subroutine  MATMOD  generates  each  new  column  by  calling  the 
MINOS  subroutine  MATCOL. 


J 
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2.1  Subroutine  FUNOBJ 
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2.  USER- WRITTEN  SUBROUTINES 

To  solve  a  purely  linear  problem,  only  a  SPECS  file  and  an  MPS  file  (and  possibly  a  BASIS  File) 
need  be  supplied. 

For  nonlinear  problems,  one  must  also  provide  some  appropriate  Fortran  code.  Nonlinearities 
in  the  objective  function  are  defined  by  subroutine  FUNOBJ.  Those  in  the  constraints  arc  defined 
separately  by  subroutine  FUNCON.  On  every  entry  except  perhaps  the  last,  these  subroutines  must 
return  appropriate  function  values  F.  Wherever  possible,  they  should  also  return  aif  gradient 
components  in  the  array  G.  This  provides  maximum  reliability  and  corresponds  to  the  default 
setting,  DERIVATIVE  LEVEL  =  3. 

In  practice  it  is  often  convenient  not  to  code  gradients.  MINOS  is  able  to  estimate  gradients 
by  finite  differences,  by  making  a  call  to  FUNOBJ  or  FUNCON  for  each  variable  Xj  whose  partial 
derivatives  need  to  be  estimated.  However,  this  reduces  the  reliability  of  the  optimization 
algorithms,  and  it  can  be  very  expensive  if  there  arc  many  such  variables  Xj. 

As  a  compromise,  MINOS  allows  you  to  code  as  many  gradients  as  you  like.  This  option  is 
implemented  as  follows:  just  before  a  function  routine  is  called,  each  clement  of  the  gradient  array 
G  is  initialized  to  a  specific  value.  On  exit,  any  clement  retaining  that  value  must  be  estimated 
by  finite  differences. 

Some  rules  of  thumb  follow: 

1.  For  maximum  simplicity  and  reliability,  compute  F  and  all  components  of  G. 

2.  If  not  all  gradients  arc  known,  compute  as  many  of  them  as  you  can.  (It  often  happens  that 
some  of  them  are  constant  or  even  zero.) 

3.  If  some  gradients  are  known  (but  not  all),  it  may  be  convenient  to  compute  them  each  time 
the  function  routines  arc  called,  even  though  they  will  be  ignored  if  MODE  ==  2. 

4.  If  the  known  gradients  are  expensive  to  compute,  use  the  parameter  MODE  to  avoid  computing 
them  on  certain  entries. 

5.  While  the  function  routines  arc  being  developed,  use  the  VERIFY  parameter  to  check  the 
computation  of  any  gradient  elements  that  are  supposedly  known. 


2.1  Subroutine  FUN08J 

This  subroutine  is  provided  by  the  user  to  calculate  the  objective  function  F{ x)  and  as  much  of 
its  gradient  g(x)  as  possible.  (It  is  not  needed  if  the  objective  function  is  entirely  linear.) 


Specification: 

SUBROUTINE  FUNOBJ (  MODE,  N,  X,  F,  G,  NSTATE ,  NPROB,  Z,  NVCORE  ) 

IMPLICIT  REAL*8(A-H,0-Z) 

DIMENSION  X(N) ,  G(N),  Z(NWCORE) 

(The  IMPLICIT  statement  should  not  be  used  on  machines  for  which  single-precision  floating¬ 
point  is  adequate;  e.g.,  Burroughs  and  CDC.) 


10  2.  User -  written  Sub^ 

Parameters: 

MODE  (Input)  This  parameter  can  be  ignored  if  DERIVATIVE  LEVEL  =  1  or  3  (i.e.,  if  ail  ele¬ 
ments  of  G  arc  computed).  In  this  case,  MODE  will  always  have  the  value  2. 

Otherwise,  you  must  specify  DERIVATIVE  LEVEL  =  0  or  2  in  the  SPECS  file  to  indicate 
that  FUNOBJ  will  not  compute  all  of  G.  MINOS  will  then  call  FUNQBJ  sometimes  with 
MODE  =  2  and  sometimes  with  MODE  =  0.  You  may  test  MODE  to  decide  what  to  do: 

If  MODE  =  2,  compute  F  and  as  many  components  of  G  as  possible. 

If  MODE  =  0,  compute  F  but  set  G  only  if  you  wish.  (On  return,  the  contents  of  G  will 
be  ignored.) 

(Output)  If  for  some  reason  you  wish  to  terminate  solution  of  the  current  problem,  set 
MODE  to  a  negative  value,  e.g.,  —1. 

M  (Input)  The  number  of  variables  involved  in  F(x).  These  must  be  the  first  N  variables 

in  the  problem. 

X(*)  (Input)  An  array  of  dimension  N  containing  the  current  values  of  the  nonlinear  variables 

x. 

F  (Output)  The  computed  value  of  the  objective  function  F(x). 

G(*)  (Output)  The  computed  gradient  vector  g(x).  In  general,  G(j)  should  be  set  to  the 
partial  derivative  dF/dij  for  as  many  j  as  possible  (except  perhaps  if  MODE  =  0 — see 
above). 

NSTATE  (Input)  If  N STATE  =  0,  there  is  nothing  special  about  the  current  call  to  FUNOBJ. 

If  NSTATE  —  I,  MINOS  is  calling  your  subroutine  for  the  first  time.  Some  data  may  need 
to  be  input  or  computed  and  saved  in  local  or  C0ML0N  storage.  Note  that  if  there  are 
nonlinear  constraints,  the  first  call  to  FUNCON  will  occur  before  the  first  call  to  FUNOBJ. 
If  NSTATE  >  2,  MINOS  is  calling  your  subroutine  for  the  last  time.  You  may  wish 
to  perform  some  additional  computation  on  the  final  solution.  (If  CYCLE  LIMIT  is 
specified,  this  call  occurs  at  the  end  of  each  cycle.)  Note  again  that  if  there  are  nonlinear 
constraints,  the  last  call  to  FUNCON  will  occur  before  the  last  call  to  FUNOBJ. 

In  general,  the  last  call  is  made  with  NSTATE  =  2  4-  IERR,  where  IERR  indicates  the 
status  of  the  final  solution.  In  particular,  if  NSTATE  =  2,  the  current  X  is  optimal;  if 
NSTATE  =  3,  the  problem  appears  to  be  infeasible;  ir  NSTATE  =  4,  the  problem  appears 
to  be  unbounded;  and  if  NSTATE  =  5,  the  iterations  limit  was  reached.  In  some  cases, 
the  solution  may  be  nearly  optimal  if  NSTATE  =11;  this  value  occurs  if  the  linesearch 
procedure  was  unable  to  find  an  improved  point. 

If  the  nonlinear  functions  arc  expensive  to  evaluate,  it  may  be  desirable  to  do  nothing 
on  the  last  call,  by  including  a  statement  of  the  form  IF  (NSTATE  .GE.  2)  RETURN 
at  the  start  of  the  subroutine. 

NPROB  (Input)  An  integer  that  can  be  set  by  a  card  of  the  form  PROBLEM  NUMBER  n  in  the 
SPECS  file. 

Z(*)  (Input)  The  primary  work  array  used  by  MINOS.  In  certain  applications  it  may  be 
desirable  to  access  parts  of  this  array,  using  various  COMMON  blocks  to  pinpoint  the 
required  locations.  (For  example,  the  dual  variables  arc  stored  in  Z(LPI)  onward,  where 
LPI  is  the  first  integer  in  the  COMMON  block  MSLOC.)  Otherwise,  Z  and  NVCORE  can  be 
ignored. 

NVCORE  (Input)  The  dimension  of  Z. 
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2.2  FUNCON 
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2.2  Subroutine  FUNCON 

This  subroutine  is  provided  by  the  user  to  compute  the  nonlinear  constraint  functions  f(x)  and 
as  many  of  their  gradients  as  possible.  (It  is  not  needed  if  the  constraints  arc  entirely  linear.) 
Note  that  the  gradients  of  the  vector  f(x )  define  the  Jacobian  matrix  J(x).  The  y-th  column  of 
J(x)  is  the  vector  df  /dx,. 

FUNCON  may  be  coded  in  two  different  ways,  depending  on  the  method  UBed  for  storing  the 
Jacobian,  as  specified  in  the  SPECS  file. 


JACOBIAN  =  DENSE 


Specification: 

SUBROUTINE  FUNCON(  NODE.  M.  N.  NJAC.  X.  F.  G.  NSTATE.  NPROB.  Z.  NWCORE  > 
IMPLICIT  REAL*8 (A-H, 0-Z) 

DIMENSION  X(N),  F(M) .  G(M.N),  Z(NWCORE) 

Parameters: 

MODE  (Input)  This  parameter  can  be  ignored  if  DERIVATIVE  LEVEL  *  2  or  3  (i.e.,  if  all  ele¬ 
ments  of  G  are  computed).  In  this  case,  MODE  will  always  have  the  value  2. 

Otherwise,  you  must  specify  DERIVATIVE  LEVEL  =  0  or  1  in  the  SPECS  file  to  indicate 
that  FUNCON  will  not  compute  all  of  G.  You  may  then  test  MODE  to  decide  what  to  do: 

If  MODE  —  2,  compute  F  and  as  many  components  of  G  as  possible. 

If  MODE  =  0,  compute  F  but  set  G  only  if  you  wish.  (On  return,  the  contents  of  G  will 
be  ignored.) 

(Output)  If  for  some  reason  you  wish  to  terminate  solution  of  the  current  problem,  set 
MODE  to  a  negative  value,  e.g.,  —1. 

M  (Input)  The  number  of  nonlinear  constraints  (not  counting  the  objective  function). 

These  must  be  the  first  M  constraints  in  the  problem. 

N  (Input)  The  number  of  variables  involved  in  /(z).  These  must  be  the  first  N  variables 

in  the  problem. 

NJAC  (Input)  The  value  M*N. 

X(*)  (Input)  An  array  of  dimension  N  containing  the  current  values  of  the  nonlinear  variables 
z. 

F(«)  (Output)  The  computed  values  of  the  functions  in  the  constraint  vector  /(x). 

G(*,*)  (Output)  The  computed  Jacobian  matrix  J(x).  The  y-th  column  of  J(x)  should  be 
stored  in  the  y-th  column  of  the  2-dimensional  array  G  (except  perhaps  if  MODE  =  0 — 
see  above).  Equivalently,  the  gradient  of  the  t-th  constraint  should  be  stored  in  the  t-th 
row  of  G. 

The  other  parameters  are  the  same  as  for  subroutine  FUNOBJ. 
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JACOBIAN  =  SPARSE 


Specification: 

SUBROUTINE  FUNCON(  MODE,  M.  N.  NJAC,  X.  F.  G.  NSTATE.  NPROB.  Z.  NWCORE  ) 
IMPLICIT  REAL *8 (A-H, O-Z) 

DIMENSION  X(N) ,  F(M) ,  G(NJAC).  Z(NWCORE) 

This  is  the  same  as  for  JACOBIAN  =  DENSE,  except  for  the  declaration  of  G  (NJAC) . 


Parameters: 

NJAC  (Input)  The  number  of  nonzero  elements  in  the  Jacobian  matrix  J( x).  This  is  exactly 
the  number  of  entries  in  the  MPS  file  that  referred  to  nonlinear  rows  and  nonlinear 
Jacobian  columns  (the  first  M  rows  in  the  ROWS  section  and  the  first  N  columns  in  the 
COLUMNS  section). 

Usually  NJAC  will  be  less  than  M*N.  The  actual  value  of  NJAC  may  not  be  or  any  use 
when  coding  FUNCON,  but  in  ail  cases,  any  expression  involving  G(f)  should  have  the 
subscript  l  between  1  and  NJAC. 

G(*)  (Output)  The  computed  elements  of  the  Jacobian  matrix  (except  perhaps  if  MODE  =  0— 
see  previous  page).  These  elements  must  be  stored  into  G  in  exactly  the  same  positions 
as  implied  by  the  MPS  file.  There  is  no  internal  check  for  consistency  (except  indirectly 
via  the  VERIFY  parameter),  so  great  care  is  essential. 

The  other  parameters  are  the  same  as  for  JACOBIAN  =  DENSE. 


2.3  Constant  Jacobian  Elamants 

If  all  constraint  gradients  (Jacobian  elements)  are  known  (DERIVATIVE  LEVEL  =  2  or  3),  any 
constant  elements  may  be  specified  in  the  MI’S  file  if  desired.  An  clement  of  G  that  is  not 
computed  in  FUNCON  will  retain  the  value  implied  by  the  MI’S  file.  (The  value  is  taken  to  be  zero 
if  not  given  explicitly  in  the  MPS  file.) 

This  feature  is  useful  when  JACOBIAN  =  DENSE  and  many  Jacobian  elements  are  identically 
zero.  Such  elements  need  not  be  specified  in  the  MPS  file,  nor  set  in  FUNCON. 

Note  that  constant  nonzero  elements  do  affect  F.  Thus,  tf  ,/tJ  is  defined  in  the  MPS  file  and 
is  constant,  the  array  element  G(t,j)  need  not  be  set  in  FUNCON,  but  the  value  G (i,j)*X(j)  must 
be  added  to  F  (0 . 

When  JACOBIAN  =  SPARSE,  constant  Jacobian  elements  will  normally  not  be  listed  in  the 
MPS  file  unless  they  are  nonzero.  If  the  correct  value  is  entered  in  the  MPS  file,  the  corresponding 
element  G(D  need  not  be  reassigned,  but  a  term  of  the  form  G(/)*X(ji)  must  be  added  to  one  of 
the  elements  of  F.  (This  feature  allows  a  matrix  generator  to  output  constant  data  to  the  MPS 
file;  FUNCON  docs  not  need  to  know  that  data  at  compile  time,  but  can  use  it  at  run  time  to 
compute  the  elements  of  F.) 

Remember,  if  DERIVATIVE  LEVEL  <  2,  unassigned  elements  of  G  are  not  treated  as  constant; 
they  are  estimated  by  finite  differences,  at  significant  expense. 


2.4  Subroutine  MATMOD 


This  subroutine  is  called  at  the  start  of  every  cycle  except  the  first.  If  CYCLE  LIMIT  k  is  specified 
with  jfc  >  1,  you  may  wish  to  provide  your  own  MATMOD  to  make  certain  changes  to  the  problem 
data.  MINOS  will  make  a  Hying  start  on  the  modified  problem,  retaining  the  current  set  of 
basic,  superbasic  and  nonbasic  variables,  the  reduced  Hessian  approximation  R,  and  the  Lagrange 
multiplier  estimates  Xk  tor  any  nonlinear  constraints.  (The  UU  factorisation  of  the  basis  is  not 
retained;  it  will  be  recomputed.) 


Specification: 


* 

* 

* 

* 


SUBROUTINE  MATMOD (. NCYCLE .  NPROB,  FINISH. 

M.  N.  NB,  NE.  NKA,  NS.  NSCL. 
A.  HA.  KA,  BL.  BU. 

ASCALE,  HS.  ID1.  ID2. 

X.  PI,  Z.  NWCORE  ) 


IMPLICIT  REALMS (A-H.O-Z) 

INTEGER*2  HA(NE) .  HS(NB) 

INTEGER  KA(NKA) .  IDl(NB).  ID2(NB) 

DIMENSION  A(NE) .  ASCALE (NSCL) .  BL(NB) .  BU(NB) 

DIMENSION  X(NB) ,  PI(M).  Z (NWCORE) 

LOGICAL  FINISH 


Parameters: 

NCYCLE  (Input)  The  number  of  the  cycle  that  has  just  terminated. 

NPROB  (Input)  An  integer  that  can  be  set  by  a  card  of  the  form  PROBLEM  NUMBER  n  in  the 

SPECS  file. 

FINISH  (Input)  On  entry,  FINISH  =  .FALSE. 

(Output)  On  exit,  if  you  wish  the  cycles  to  be  terminated  (e.g.,  if  some  convergence 
criterion  has  been  satisfied),  set  FINISH  =  .TRUE. 

M  (Input)  The  number  of  rows  in  the  constraint  matrix. 

N  (Input)  The  number  of  variables,  excluding  slacks. 

NB  (Input)  The  number  of  variables,  including  slacks.  (NB  =  N  +  M;  it  is  the  length  of  many 

arrays  including  BL  and  BU.  The  name  is  short  for  Number  of  Bounds.) 

NE  (Input)  The  number  of  elements  in  the  constraint  matrix  (used  only  to  dimension  A  and 
HA). 

NKA  (Input)  NKA  =  N  +  1  (used  to  dimension  KA). 

NS  (input)  The  number  of  superbasic  variables. 

NSCL  (Input)  If  NSCL  =  1,  the  constraint  matrix  has  not  been  sealed;  there  is  only  one  element 
in  the  array  ASCALE  and  it  is  undefined. 
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Otherwise,  NSCL  =  NB  and  the  constraint  matrix  has  been  scaled.  An  original  element 
dij  is  now  stored  in  A  as  aij  X  ASCALE (N+t)  /ASCALE (j) .  Similarly,  an  original  bound  lj 
on  a  column  or  slack  ( j  =  1  to  NB)  is  now  stored  in  BL  (j)  as  l}  X  ASCALE  (j) .  (Likewise 
for  upper  bounds.)  Any  new  or  modified  elements  must  be  treated  accordingly. 

A(*)  (Input,  output)  The  current  elements  of  the  constraint  matrix,  stored  column-wise. 

They  may  be  altered  as  desired.  Additional  entries  in  A,  HA  and  KA  associated  with 
“phantom  columns”  must  be  set  by  calling  subroutine  MATCQL. 

HA(*)  (Input,  output)  The  row  indices  associated  with  A. 

KA(*)  (Input,  output)  KA  (j)  points  to  the  start  of  column  j  in  the  arrays  A(*),  HA(*). 

BL(0  (Input,  output)  The  lower  bounds  on  all  column  and  slack  variables,  in  that  order.  They 

may  be  altered  as  desired. 

BU(*)  (Input,  output)  The  upper  bounds  on  all  variables,  including  slacks.  They  may  be 
altered  as  desired. 

ASCALE  (*)  (Input)  The  set  of  scale  factors  for  columns  and  rows,  in  that  order  (if  NSCL  >  l). 
HS(*)  (Input)  The  state  vector  for  all  variables. 

HS (j)  =  0  if  variable  j  is  nonbasic  at  its  lower  bound; 

HS  (j)  =  1  if  variable  j  is  nonbasic  at  its  upper  bound; 

HS  (j)  =  2  if  variable  j  is  superbasic; 

HS  (j)  -  3  if  variable  j  is  basic. 

ID1  (*)  (Input)  The  first  half  of  the  names  of  the  columns  and  rows,  in  that  order,  in  A4  format. 

(Sometimes  it  may  be  useful  to  determine  the  index  of  a  column  or  row  by  searching 
ID1  and  102.) 

ID2(*)  (Input)  The  second  half  of  the  names  of  the  columns  and  rows,  in  A4  format. 

X(«)  (Input)  The  numerical  values  of  all  columns  and  slack  variables. 

PI(*)  (Input)  The  numerical  values  of  the  dual  variables.  The  first  mj  components  will  be 
the  current  estimates  of  X,  the  Lagrange  multipliers  for  the  nonlinear  constraints. 

Z(*)  (Input)  The  primary  work  array  used  by  MINOS.  In  certain  applications  it  may  be 
desirable  to  access  parts  of  this  array,  using  various  COMMON  blocks  to  pinpoint  the 
required  locations. 

NWCORE  (Input)  The  dimension  of  Z. 


2.6  Matrix  Data  Structure 
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2.5  Subroutine  MATCOL 

If  PHANTOM  COLUMNS  c  and  PHANTOM  ELEMENTS  e  are  defined  in  the  SPECS  file  (along  with  CYCLE 
LIMIT  k),  this  subroutine  may  be  called  by  MATMOD  up  to  c  times  throughout  cycles  2  through  k. 
The  aim  is  to  turn  at  most  c  “phantom  columns”  into  normal  columns  containing  a  total  of  at 
most  c  nonzero  elements.  MATMOD  must  provide  an  array  C0L(*)  and  a  zero  tolerance  ZTOL  for 
each  call.  The  significant  elements  of  COL  will  be  packed  into  the  matrix  data  structure,  to  form 
a  new  column.  The  associated  variable  will  be  given  the  default  LOWER  and  UPPER  bounds,  and  a 
scale  factor  of  1 . 0. 

Specification: 

SUBROUTINE  MATCOL (  M,  N,  NB,  NE,  NKA, 

*  A.  HA.  KA.  BL.  BU.  COL.  ZTOL  ) 

IMPLICIT  REAL*8(A-H,0-Z) 

INTEGERS  HA(NE) 

INTEGER  KA(NKA) 

DIMENSION  ACNE),  BL (NB) ,  BU (NB) ,  COL(M) 

Parameters: 

M  (Input)  The  length  of  the  array  COL.  Usually  this  will  be  m,  the  number  of  rows  in  the 

constraint  matrix.  In  general,  it  may  be  anywhere  in  the  range  1  <  M  <  m,  if  the  new 
column  is  known  to  be  zero  beyond  position  M. 

C0L(*)  (Input)  The  dense  vector  that  is  to  become  a  new  matrix  column. 

ZTOL  (Input)  A  zero  tolerance  for  deleting  negligible  elements  from  COL  when  it  is  packed 

into  A  and  HA.  On  most  machines,  a  reasonable  value  is  ZTOL  =  1.0E-8. 

The  other  parameters  come  directly  from  MATMOD.  For  further  details,  see  the  CYCLE  options  in 
section  3.3,  and  the  example  in  section  8.5. 

2.6  Matrix  Oats  Structurs 

In  the  MINOS  source  code,  the  constraint  matrix  A  is  stored  column-wise  in  sparse  format  in  the 
arrays  A,  HA,  KA,  as  defined  in  the  specifications  of  subroutine  MATMOD  (section  2.4).  The  matrix 
/  associated  with  the  slack  variables  is  represented  implicitly.  If  the  objective  function  contains 
linear  terms  cTz  +  dTy,  then  ( eT  d?)  is  included  as  the  IOBJ-th  row  of  A  (see  the  COMMON  block 
M5L0BJ  below). 

If  there  are  nonlinear  constraints,  the  top  left-hand  corner  of  A  is  loaded  with  the  current 
Jacobian  matrix  at  the  start  of  each  major  iteration. 

The  following  COMMON  blocks  contain  dimensions  and  other  items  relating  to  the  storage  of 

A. 

COMMON  /M3LEN  /  If  ,N  .NB  .NSCL 
M  m,  the  number  of  rows  in  A,  including  the  linear  objective  row  (if  any). 

N  n,  the  number  of  columns  in  A,  possibly  including  c  “phantom  columns”. 

NB  n  +  m  =  N+M,  the  total  number  of  variables  in  the  problem,  including  the  slacks. 

NSCL  Cither  NB  or  1,  depending  on  whether  SCALE  has  been  specified  or  not. 
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HE 

NKA 

LA 

LHA 

LKA 


MAXR 

MAXS 

MBS 

NN 

NNO 

NR 

NX 


SINF 

WTOBJ 

MINIMZ 

NINF 

IOBJ 


FOBJ 

FOBJ2 

NNOBJ 

NNOBJO 


NJAC 

NNCON 

NNCONO 

NNJAC 


COMMON  /M2MAPA/  NE  .NKA  .LA  .LHA  .LKA 

The  number  of  nonzero  elements  in  A,  possibly  including  e  “phantom  elements”. 

n  +  I  =  M+l,  the  number  of  pointers  in  the  array  KA. 

The  address  of  A(*)  in  the  work  array  Z(*). 

The  address  of  HA(*)  in  the  work  array  Z(*). 

The  address  of  KA(*)  in  the  work  array  Z(*). 

COMMON  /M5LEN  /  MAXR  .MAXS  .MBS  .NN  .NNO  ,NR  .NX 

The  HESSIAN  DIMENSION. 

The  SUPERBASICS  LIMIT. 

M+MAXS,  the  maximum  number  of  basic  and  supcrbasic  variables, 
n,  =  max{NNOBJ,  NNJAC},  the  number  of  NONLINEAR  VARIABLES. 
max{l,NN}. 

The  dimension  of  the  array  R  that  is  used  to  approximate  the  reduced  Hessian,  R. 
max  {MBS,  NN}. 

COMMON  /M5L0BJ/  SINF  .WTOBJ  .MINIMZ. NINF  .IOBJ 

The  current  sum  of  infeasibilities. 

The  scalar  w  used  in  the  composite  objective  technique. 

+  1  if  the  objective  is  to  be  minimized;  —1  if  it  is  to  be  maximized. 

The  current  number  of  infcasibilitics. 

The  row  number  for  the  linear  objective.  (If  IOBJ  is  zero,  there  is  no  such  row.) 

COMMON  /M7LEN  /  FOBJ  .F0BJ2  .NNOBJ  .NNOBJO 

The  current  value  of  the  function  value  F  returned  by  FUNOBJ. 

A  temporary  value  of  FOBJ. 

«',,  the  number  or  NONLINEAR  OBJECTIVE  VARIABLES. 
max{l,  NNOBJ}. 

COMMON  /M8LEN  /  NJAC  .NNCON  .NNCONO. NNJAC 
The  number  of  elements  in  the  Jacobian. 
mt,  the  number  of  NONLINEAR  CONSTRAINTS. 
max{l,  NNCON}. 

n'{,  the  number  of  NONLINEAR  JACOBIAN  VARIABLES. 


3. 1  SPECS  File  Format 
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3.  THE  SPECS  FILE 

The  SPECS  file  sets  various  run-time  parameters  that  describe  the  nature  of  the  problem  being 
solved  and  the  manner  in  which  a  solution  is  to  be  obtained.  The  tile  consists  of  a  sequence  of 
card  images,  each  of  which  contains  a  keyword  and  certain  associated  values. 

The  first  keyword  is  BEGIN  and  the  last  keyword  is  END.  If  the  problem  could  be  solved 
using  default  values  for  all  parameters,  the  SPECS  file  could  consist  of  just  those  two  keywords 
(on  separate  cards).  Normally,  however,  at  least  some  of  the  parameters  must  be  specified;  for 
example,  the  number  of  nonlinear  variables  if  there  are  any. 


3.1  SPECS  File  Format 

Each  card  in  the  SPECS  file  contains  a  sequence  of  items  in  free  format  (they  may  appear 
anywhere  in  columns  l  to  72).  The  items  arc  separated  by  spaces  or  equal  signs  ('  ’  or  *=’). 
Those  selected  from  each  card  arc: 

1.  The  first  word  (the  keyword).  Only  the  first  3  characters  are  significant. 

2.  The  second  word  (if  any).  Sometimes  this  is  the  keyword's  associated  name  value,  an  8- 
character  name.  More  often  it  qualifies  the  keyword,  and  its  first  4  characters  are  significant. 

3.  The  first  number  (if  any).  This  may  be  an  integer  value  or  a  real  value;  up  to  8  characters  in 
Fortran’s  I,  F,  E  or  D  format. 

In  the  following  examples  the  significant  characters  are  underlined: 


OBJECTIVE 

PROFIT 

SOLUTION  FILE 

12 

ROWS 

500 

ROW  tolerance 

0.0001 

LOWER  BOUND 

zlsQ 

AIJ  TOL 

1.0E-6 

If  the  first  character  of  an  item  is  one  of  the  following  numeric  characters 

1234587890+-  . 


then  the  item  is  taken  to  be  a  number.  The  number  may  be  from  1  to  8  contiguous  numeric 
characters,  including  an  E  or  a  D  if  need  be.  It  is  terminated  by  a  non-numeric  character  such  as 
a  space. 

(An  exception  is  made  for  the  keywords  OBJECTIVE,  RHS,  RANGE  and  BOUND,  which  specify 
names  to  be  extracted  from  the  MPS  file.  For  these  keywords  the  second  item  is  taken  to  be  the 
required  name  value  even  if  it  begins  with  a  numeric  character.  Thus, 

AIJ  TOLERANCE  .00001 

OBJECTIVE  .00001 

RHS  ... ZE001 

BOUND  +1000 

are  all  allowed.  However,  names  like  OBJECTIVE  =  COST  or  RHS  =  DEMAND02  will  be  more  com¬ 
mon.) 

Blank  cards  and  comments  may  be  used  to  improve  readability.  A  comment  begins  with  an 
asterisk  ('*’)  and  includes  all  subsequent  characters  on  the  same  card;  these  arc  ignored.  The  **’ 
may  be  the  first  non-blank  character  on  the  card,  or  the  first  non-blank  after  a  space  or  an  equal 
sign.  For  example: 


SgjfiE 
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3.  The  SPECS  File 


* 

*  UPS  file  parameters 

* 

ROWS  1000  *  (or  less) 

COLUMNS  2000  *  (or  less) 

ELEMENTS  8000  *  (or  less) 

OBJECTIVE  =  PR0FIT02  *  (the  2nd  N  row) 

Scanning  terminates  once  a  number  has  been  recognized.  An  asterisk  is  therefore  not  essential 
following  a  number: 

WEIGHT  ON  OBJECTIVE  =10.0  DURING  PHASE  1 

3.2  SPECS  File  Checklist  and  Defaults 

The  following  example  SPECS  file  shows  all  valid  keywords  and  their  default  values.  The  keywords 
are  grouped  according  to  the  function  they  perform. 

Some  of  the  default  values  depend  on  <,  the  relative  precision  or  the  vine  being  used.  The 
values  given  here  correspond  to  double-precision  arithmetic  on  IBM  3t  370  systems  and 

their  successors  (t  «  2.22  X  10-16).  Similar  values  would  apply  to  any  machine  having  about  15 
decimal  digits  of  precision. 


BEGIN  checklist  of  SPECS  file  parameters  and  their  default  values 


* 

*  Keywords  for  the  MPS  file 

$ 

MINIMIZE 

♦ 

(opposite  of  MAXIMIZE) 

OBJECTIVE  = 

7 

* 

the  first  name  encountered 

RHS  = 

? 

* 

the  first  name  encountered 

RANGE  = 

T 

* 

the  first  name  encountered 

BOUNDS  = 

7 

* 

the  first  name  encountered 

ROWS 

100 

* 

COLUMNS 

300 

* 

or  3»R0WS 

ELEMENTS  (or  COEFFICIENTS) 

1500 

* 

or  5 ’COLUMNS 

AIJ  TOLERANCE 

1.0E-10 

* 

LOWER  BOUND 

0.0 

* 

UPPER  BOUND 

1.0E+20 

* 

plus  infinity 

MPS  FILE 

7 

♦ 

depends  on  installation 

LIST  LIMIT 

0 

* 

for  printing  MPS  data 

ERROR  MESSAGE  LIMIT 

* 

10 

* 

during  MPS  input 

*  Keywords  for  the  simplex  method 

* 


CRASH  OPTION 

1 

* 

ail  variables  eligible  for  initial  basis 

ITERATIONS  LIMIT 

300 

* 

or  3*R0WS  +  10’NONLINEAR  VARIABLES 

PARTIAL  PRICE 

1 

* 

or  COLS/ (2*R0WS)  if  COLS  is  large 

MULTIPLE  PRICE 

1 

* 

BEWARE  -  not  like  commercial  LP 

WEIGHT  ON  LINEAR  OBJECTIVE 

0.0 

♦ 

during  phase  1 

3.2  SPECS  Vile  Checklist  and  Defaults 


SUMMARY  FILE  0 

SUMMARY  FREQUENCY  100 

LOG  FREQUENCY  1 

CHECK  FREQUENCY  30 

FACTORIZATION  FREQUENCY  BO 

SAVE  FREQUENCY  100 

SCALE  NO 

SOLUTION  YES 

* 

*  BASIS  files 

* 

OLD  BASIS  FILE  0 

NEW  BASIS  FILE  0 

BACKUP  BASIS  FILE  0 

INSERT  FILE  0 

PUNCH  FILE  0 

LOAD  FILE  0 

DUMP  FILE  0 

SOLUTION  FILE  0 

* 

*  Convergence  and  stability  tolerances 

* 

FEASIBILITY  TOLERANCE  1.0E-6 

OPTIMALITY  TOLERANCE  1.0E-6 

PIVOT  TOLERANCE  3.7E-11 

LU  FACTOR  TOLERANCE  10.0 

LU  UPDATE  TOLERANCE  10.0 

* 

*  Parameters  for  nonlinear  problems 

* 

NONLINEAR  CONSTRAINTS  0 

NONLINEAR  VARIABLES  0 

NONLINEAR  OBJECTIVE  VARIABLES  0 

NONLINEAR  JACOBIAN  VARIABLES  0 

SUPERBASICS  LIMIT  1 

HESSIAN  DIMENSION  1 

* 

PROBLEM  NUMBER  0 

DERIVATIVE  LEVEL  3 

VERIFY  LEVEL  0 

EMERGENCY  VERIFY  LEVEL  0 

* 

START  OBJECTIVE  CHECK  AT  COL  1 

STOP  OBJECTIVE  CHECK  AT  COL  n, 

START  CONSTRAINT  CHECK  AT  COL  1 

STOP  CONSTRAINT  CHECK  AT  COL  n, 


*  >  0  for  occasional  output  to  terminal 

*  iteration  log  on  SUMMARY  file 

*  iteration  log  on  PRINT  file 

*  numerical  test  on  row  residuals 

*  refactorize  the  basis  matrix 

*  basis  map 

*  linear  constraints  and  variables 

*  on  PRINT  file 


*  input  basis  map 

*  output  basis  map 

*  output  basis  map 

*  input  in  industry  format 

*  output  INSERT  data 

*  input  names  and  values 

*  output  LOAD  data 

*  separate  from  printed  solution 


*  for  satisfying  bounds 

*  for  reduced  gradients 

*  ei 

*  limits  size  of  multipliers  in  L 

*  the  same  during  updates 


*  must  be  the  exact  number,  mi 

*  must  be  the  exact  number,  «i 

*  use  if  different  from  Jacobian  variables 

*  use  if  different  from  objective  variables 

*  or  HESSIAN  DIMENSION 

*  or  SUPERBASICS  LIMIT 

*  sets  subroutine  parameter  NPROB 

*  assumes  all  gradients  are  known 

*  gives  cheap  check  on  gradients 

*  cheap  check  before  stopping 

* 

* 

* 

* 
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3.  The  SPECS  File 


LINESEARCH  TOLERANCE  0.1 

SUBSPACE  TOLERANCE  0 .  S 

FUNCTION  PRECISION  3.0F.-13 

DIFFERENCE  INTERVAL  5 . SE-7 

CENTRAL  DIFFERENCE  INTERVAL  6.7E-5 

* 

*  Further  parameters  for  nonlinear  constraints 


*  smaller  for  more  accurate  search 

*  affects  when  to  PRICE 

*  e0,8  (almost  full  accuracy) 

*  (FUNCTION  PRECISION)* 

*  (FUNCTION  PRECISION)* 


JACOBIAN 
LAGRANGIAN 
MAJOR  ITERATIONS 
MINOR  ITERATIONS 
PENALTY  PARAMETER 
DAMPING  PARAMETER 
* 

COMPLETION 
ROW  TOLERANCE 
RADIUS  OF  CONVERGENCE 
PRINT  LEVEL  (JFLXB) 

* 

*  Sequences  of  related  problems 

* 

CYCLE  LIMIT 
CYCLE  PRINT 
CYCLE  TOLERANCE 
PHANTOM  COLUMNS 
PHANTOM  ELEMENTS 
* 

*  Miscellaneous 

* 

DEBUG  LEVEL 

LINESEARCH  DEBUG  AFTER  ITN 
WORKSPACE  (USER) 

WORKSPACE  (TOTAL) 

*  SUPPRESS  PARAMETER  LISTING 
END  of  SPECS  file  checklist 


DENSE 

YES 

20 

40 

100.0/m, 

2.0 

PARTIAL 

1.0E-8 

0.01 

00001 


*  may  need  to  be  larger  if  very  nonlinear 

*  affects  step-size  between  subproblems 

*  FULL  if  no  nonlinear  constraints 

*  allowable  nonlinear  constraint  violation 

*  for  reducing  the  penalty  parameter 

*  J(xk),  /(xk),  Xfc,  Xfc,  Basis  statistics 


0 

999999 

0 

7 


*  depends  on  installation 


3.3  SPECS  Pile  Definitions 
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3.3  SPECS  Fite  Definitions 

The  following  is  an  alphabetical  list  of  recognized  SPECS  file  keywords.  A  typical  use  of  each 
keyword  is  given,  along  with  a  definition  of  the  quantities  involved  and  comments  on  usage.  In 
many  cases  the  value  associated  with  a  keyword  is  denoted  by  a  letter  such  as  k,  and  allowable 
values  for  k  are  subsequently  defined. 

AIJ  TOLERANCE  t  (default  t  =  i.OE-10) 

During  input  of  the  MPS  file,  matrix  coefficients  atJ  will  be  ignored  if  |aty|  <  t. 

If  atJ  is  a  Jacobian  clement,  it  is  not  ignored.  (Its  position  is  recorded,  and  it  will  retain  the 
value  t  if  DERIVATIVE  LEVEL  =  2  or  3  and  FUNCON  does  not  reset  the  corresponding  element  of 

G) 

If  CYCLE  LIMIT  >  1  and  a,y  is  to  be  changed  from  zero  to  a  value  greater  than  t  during  a 
later  cycle,  set  t  =  0.0  to  retain  all  entries  in  the  MPS  file. 


BACKUP  BASIS  FILE  k  (default  k  =  0) 

This  is  intended  as  a  safeguard  against  losing  the  results  of  a  long  run.  Suppose  that  a  NEW 
BASIS  FILE  is  being  saved  every  100  iterations,  and  that  MINOS  is  about  to  save  such  a  basis  at 
iteration  2000.  It  is  conceivable  that  the  run  may  time-out  during  the  next  few  milliseconds  (i.e., 
in  the  middle  of  the  save),  or  the  host  computer  could  unexpectedly  crash.  In  this  case  the  basis 
file  will  be  corrupted  and  the  run  will  have  been  essentially  wasted. 

To  eliminate  this  risk,  both  a  NEW  BASIS  FILE  and  a  BACKUP  BASIS  FILE  may  be  specified. 
The  following  would  be  suitable  for  the  above  example: 

OLD  BASIS  FILE  11  (or  0) 

BACKUP  BASIS  FILE  11 
NEW  BASIS  FILE  12 

SAVE  FREQUENCY  100 

The  current  basis  will  then  be  saved  every  100  iterations,  first  on  file  12  and  then  immediately 
on  file  II.  If  the  run  is  interrupted  at  iteration  2000  during  the  save  on  file  12,  there  will  still  be 
a  useable  basis  on  file  11  (corresponding  to  iteration  1900). 

Note  that  a  NEW  BASIS  will  be  saved  at  the  end  of  a  run  if  it  terminates  normally,  but  there 
is  no  need  for  a  further  BACKUP  BASIS.  In  the  above  example,  if  an  optimum  solution  is  found 
at  iteration  2050  (or  if  the  iteration  limit  is  2050),  the  final  basis  on  file  12  will  correspond  to 
iteration  2050,  but  the  last  basis  saved  on  file  11  will  be  the  one  for  iteration  2000. 

BOUNDS  B0UND01 

This  specifies  the  8-character  name  of  the  bound  set  to  be  selected  from  the  MPS  file. 

1.  BNDS  is  a  valid  alternative  keyword. 

2.  If  BOUNDS  is  not  specified,  or  if  the  name  is  blank,  the  first  bound  set  in  the  MPS  file  will  be 
selected. 

3.  If  the  MPS  file  contains  one  or  more  bound  sets  but  you  do  not  want  any  of  them  to  be  used, 
specify  a  dummy  name  such  as  BOUND  =  NONE. 
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3.  The  SPliCS  File 


CENTRAL  DIFFERENCE  INTERVAL  h2  (default  h2  =  (FUNCTION  PRECISION)*) 

When  DERIVATIVE  LEVEL  <  3,  the  ccntral-difTcrcnee  interval  h2  is  used  near  an  optimal  solution 
to  obtain  more  accurate  (but  more  expensive)  estimates  of  gradients.  Twice  as  many  function 
evaluations  are  required  compared  to  forward  dilTerencing.  The  interval  used  for  thej-th  variable 
is  hj  =  /»2(1  +  |xj  |).  The  resulting  gradient  estimates  should  be  accurate  to  O(hJ),  unless  the 
functions  are  badly  scaled. 


CHECK  FREQUENCY  k  (default  k  —  30) 

Every  fc-th  iteration  after  the  most  recent  basis  factorization,  a  numerical  test  is  made  to  see  if 
the  current  solution  x  satisfies  the  general  linear  constraints  (including  any  linearized  nonlinear 
constraints,  if  any).  If  these  are  Ax  +  a  —  0  where  s  is  the  set  of  slack  variables,  the  residual 
vector  r  =  Ax  +  s  is  computed.  If  the  largest  component  of  r  is  judged  to  be  too  large,  the  current 
basis  is  rcfaclorizcd  and  the  basic  variables  arc  recomputed  to  satisfy  the  general  constraints  more 
accurately. 


COEFFICIENTS  6000 

Sec  ELEMENTS. 

COLUMNS  n  (default  n  =  3*R0WS) 

This  must  specify  an  over-estimate  of  the  number  of  columns  in  the  constraint  matrix  (excluding 
slack  variables,  but  including  any  PHANTOM  COLUMNS).  If  n  proves  to  be  too  small,  MINOS  will 
continue  reading  the  MI’S  file  to  determine  the  true  value  of  n,  and  an  appropriate  warning 
message  will  be  issued.  If  the  MPS  file  number  is  the  same  as  the  system  card  reader,  the  problem 
will  then  be  terminated;  otherwise  the  MPS  file  will  be  re-read. 


COMPLETION  PARTIAL  (default) 

COMPLETION  FULL 

When  there  are  nonlinear  constraints,  this  determines  whether  subproblems  should  be  solved  to 
moderate  accuracy  (PARTIAL  completion),  or  to  full  accuracy  (FULL  completion).  MINOS  effects 
the  option  by  using  two  sets  of  convergence  tolerances  for  the  subproblcms. 

Use  of  partial  completion  may  reduce  the  work  during  early  major  iterations,  unless  the  MINOR 
ITERATIONS  limit  is  active.  The  optimal  set  or  basic  and  superbasic  variables  will  probably  be 
determined  for  any  given  subproblem,  but  the  reduced  gradient  may  be  larger  than  it  would  have 
been  with  full  completion. 

An  automatic  switch  to  full  completion  occurs  when  it  appears  that  the  sequence  of  major 
iterations  is  converging.  The  switch  is  made  when  the  nonlinear  constraint  error  is  reduced  below 
100*(ROW  TOLERANCE),  the  relative  change  in  X*  is  0.1  or  less,  and  the  previous  subproblcm  was 
solved  to  optimality. 

Full  completion  tends  to  give  better  Lagrange- multiplier  estimates.  It  may  lead  to  fewer 
major  iterations,  but  may  result  in  more  minor  iterations. 

CRASH  OPTION  k  (default  k  =  l) 

If  a  starting  basis  is  not  specified,  a  triangular  basis  will  be  selected  from  certain  columns  of  the 
constraint  matrix  (A  /).  Free  rows  and  variables  are  given  priority.  Columns  are  then  chosen 
from  A  according  to  the  following  values  of  k.  Slack  columns  (from  /)  are  then  added  where 
necessary. 


3.3  SPECS  File  Definitions 
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k  Meaning 

0  The  ail-slack  basis  is  set  up. 

1  All  columns  of  A  arc  considered. 

2  Only  the  columns  of  A  corresponding  to  the  linear  variables  y  will  be  considered.  Linear 
programming  will  then  be  used  to  optimize  y  as  much  as  possible,  before  the  nonlinear 
variables  x  are  altered  from  their  initial  values.  (If  an  accurate  initial  point  xo  is 
provided,  this  may  increase  overall  efficiency.) 

3  Nonlinear  objective  variables  will  be  excluded  from  the  initial  basis. 

4  Nonlinear  Jacobian  variables  will  be  excluded  from  the  initial  basis. 


In  all  cases,  CRASH  will  refrain  from  selecting  variables  that  were  made  superbasic  by  means  of 
an  FX  indicator  in  the  INITIAL  bounds  set. 


CYCLE  LIMIT  l  (default  /  =  l) 

CYCLE  PRINT  p  (default  p  =  l) 

CYCLE  TOLERANCE  t  (default  t  =  0.0) 

PHANTOM  COLUMNS  c  (default  c  =  0) 

PHANTOM  ELEMENTS  e  (default  e  =  0) 

These  keywords  refer  to  a  facility  for  constructing  and  solving  a  sequence  of  related  problems,  as 
described  in  sections  1.9,  2.4  and  2.5.  The  COMMON  block 

COMMON  /CYCLCM/  CNVTOL. JNEW . MATERR , MAXCY . NEPHNT . NPHANT , NPRINT 
contains  certain  relevant  variables. 


1.  /  =  MAXCY  is  the  maximum  number  of  problems  to  be  solved. 

2.  p  =  NPRINT  controls  the  printing  of  intermediate  solutions.  At  most,  the  last  p  solutions  will 
be  output. 

3.  t  =  CNVTOL  is  a  real  number  for  possible  use  in  a  user- specified  convergence  test  within 
subroutine  MATMOD. 

4.  c  =  NPHANT  is  the  number  of  columns  that  can  be  added  to  the  constraint  matrix  beyond 
those  specified  in  the  MPS  file.  Each  column  must  be  added  by  means  of  a  call  to  subroutine 
MATCOL.  If  an  error  occurs,  MATCOL  increments  MATERR  (which  is  initially  zero).  Otherwise, 
JNEW  records  the  index  of  the  new  column. 

5.  e  =  NEPHNT  is  the  number  of  nonzero  elements  that  are  allocated  to  the  “phantom  columns” 
beyond  those  specified  in  the  MPS  file. 


DAMPING  PARAMETER  d  (default  d  =  2.0) 

This  parameter  may  assist  convergence  on  problems  that  have  highly  nonlinear  constraints.  It  is 
intended  to  prevent  large  relative  changes  between  subprobtem  solutions  (i*,  X*)  and  (x*+i,  X*+j). 
For  example,  the  default  value  2.0  prevents  the  relative  change  in  cither  x^  or  X*  from  exceeding 
200  per  cent.  It  will  not  be  active  on  well-behaved  problems. 

The  parameter  is  used  to  interpolate  between  the  solutions  at  the  beginning  and  end  of  each 
major  iteration.  Thus,  x*+i  and  X*+i  are  changed  to 

xfc  +  <r(xfe+,  -  xfc)  and  X*  +  <r(X*+t  -  Xfc) 

for  some  step-length  e  <  1.  (In  the  case  of  nonlinear  equations,  this  gives  a  damped  Newton 
method.) 
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3.  The  SPECS  File 


1.  Thin  is  a  very  crude  control.  If  the  sequence  of  major  iterations  does  not  appear  to  be 
converging,  one  should  first  rc-run  the  problem  with  a  higher  PENALTY  PARAMETER  p  (say  10 
or  100  times  the  default  p).  (Skip  this  re-run  in  the  case  of  nonlinear  equations.  There  are 
no  degrees  of  freedom  and  the  value  of  p  is  irrelevant.) 

2.  If  the  subproblcm  solutions  continue  to  change  violently,  try  reducing  d  to  0.2  or  0.1  (say). 

3.  l'or  implementation  reasons,  the  shortened  step  a  applies  to  the  nonlinear  variables  z,  but 
not  to  the  linear  variables  y  or  the  slack  variables  s.  This  may  reduce  the  efficiency  of  the 
control. 


DEBUG  LEVEL  d  (default  d  —  0) 

This  causes  various  amounts  of  information  to  be  output  to  the  PRINT  file. 

k  Meaning 

0  No  debug  output. 

2  (or  more)  Output  from  M5SETX  showing  the  maximum  residual  after  a  row  check. 

40  Output  from  LU8RPC  showing  the  position  of  the  last  nonzero  in  the  transformed 
incoming  column. 

50  Output  from  LU2FAC  showing  each  pivot  row  and  column  and  the  dimensions  of  the 
dense  matrix  involved  in  the  associated  elimination. 

100  Output  from  M2BFAC  and  M5LQG  listing  the  basic  and  superbasic  variables  and  their 
values  at  every  iteration. 


DERIVATIVE  LEVEL  d  (default  d  —  3) 

This  specifies  which  nonlinear  function  gradients  arc  known  analytically  and  will  be  supplied  to 
MINOS  by  the  user  subroutines  FUN0BJ  and  FUNC0N. 

d  Meaning 

3  All  objective  and  constraint  gradients  are  known. 

2  AH  constraint  gradients  are  known,  but  some  or  all  components  of  the  objective  gradient 
are  unknown. 

1  The  objective  gradient  is  known,  but  some  or  all  of  the  constraint  gradients  are  un¬ 
known. 


0  Some  components  of  the  objective  gradient  are  unknown  and  some  of  the  constraint 
gradients  arc  unknown. 


3.3  SPECS  File  DeRoitioaa 
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The  value  d  —  3  should  be  used  whenever  possible.  It  is  the  most  reliable  and  will  usually  be  the 
most  efficient. 

If  d  —  0  or  2,  MINOS  will  estimate  the  missing  components  of  the  objective  gradient, 
using  finite  differences.  This  may  simplify  the  coding  of  subroutine  FUNOBJ.  However,  it  could 
increase  the  total  run-time  substantially  (since  a  special  call  to  FUNOBJ  is  required  for  each  missing 
clement),  and  there  is  less  assurance  that  an  acceptable  solution  will  be  located.  If  the  nonlinear 
variables  arc  not  well  scaled,  it  may  be  necessary  to  specify  a  nonstandard  DIFFERENCE  INTERVAL 
(see  below). 

If  d  =  0  or  1,  MINOS  will  estimate  missing  elements  of  the  Jacobian.  For  each  column  of  the 
Jacobian,  one  call  to  FUNCON  is  needed  to  estimate  all  missing  elements  in  that  column,  if  any.  If 
JACOBIAN  =  SPARSE  and  the  sparsity  pattern  of  the  Jacobian  happens  to  be 


where  *  indicates  known  gradients  and  ?  indicates  unknown  elements,  MINOS  will  use  one  call 
to  FUNCON  to  estimate  the  missing  element  in  column  2,  and  another  call  to  estimate  both  missing 
elements  in  column  3.  No  calls  arc  needed  for  columns  1  and  4. 

At  times,  central  differences  are  used  rather  than  forward  differences.  Twice  as  many  calls 
to  FUNOBJ  and  FUNCON  are  then  needed.  (This  is  not  under  the  user’s  control.) 

Remember:  when  analytic  derivatives  arc  not  provided,  the  attainable  accuracy  in  locating 
an  optimal  solution  is  usually  less  than  when  all  gradients  are  available.  DERIVATIVE  LEVEL  3  is 
stTongly  recommended. 

DIFFERENCE  INTERVAL  A,  (default  h,  —  (FUNCTION  PRECISION)*) 

This  alters  the  interval  hi  that  is  used  to  estimate  gradients  by  forward  differences  in  the  following 
circumstances: 

1.  In  the  initial  (“cheap”)  phase  of  verifying  the  objective  gradients. 

2.  For  verifying  the  constraint  gradients. 

3.  For  estimating  missing  objective  gradients. 

4.  For  estimating  missing  Jacobian  elements. 

In  the  last  three  cases,  a  derivative  with  respect  to  x3  is  estimated  by  perturbing  that  component 
of  x  to  the  value  x3  +  Ai(l  +  |xy|),  and  then  evaluating  F{x)  or  f(x)  at  the  perturbed  point.  The 
resulting  gradient  estimates  should  be  accurate  to  0(h\ )  unless  the  functions  arc  badly  scaled. 
Judicious  alteration  of  h \  may  sometimes  lead  to  greater  accuracy. 

DUMP  FILE  /  (default  /  =  0) 

If  /  >  0,  the  last  solution  obtained  will  be  output  to  file  /  in  the  format  described  in  section  5.3. 
The  file  will  usually  have  been  output  previously  as  a  LOAD  file. 

ELEMENTS  e  (default  e  =  5*C0LUMNS) 

This  must  specify  an  over-estimate  of  the  number  of  nonzero  elements  (coefficients  at})  in  the 
constraint  matrix,  including  all  entries  in  a  DENSE  or  SPARSE  Jacobian,  and  all  nonzeros  in  the 
matrices  A t,  A-i,  A%.  (It  should  also  include  the  number  of  PHANTOM  ELEMENTS,  if  any.) 

1.  COEFFICIENTS  is  a  valid  alternative  keyword. 

2.  If  e  proves  to  be  too  small,  MINOS  continues  in  the  manner  described  under  C0LUMM8. 
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EMERGENCY  VERIFY  LEVEL 
Sec  VERIFY  LEVEL. 

ERROR  MESSAGE  LIMIT  e  (default  t  =  10) 

This  is  the  maximum  number  of  error  messages  to  be  printed  for  each  type  of  error  occurring 
when  the  MI’S  file  is  read.  The  default  value  is  reasonable  for  early  runs  on  a  particular  MPS 
file.  If  the  same  file  is  used  repeatedly,  e  can  be  reduced  to  suppress  warning  of  non-fatal  errors. 

FACTORIZATION  FREQUENCY  k  (default  k  =  50) 

At  most  k  basis  changes  will  occur  between  factorizations  of  the  basis  matrix. 

1.  With  linear  programs,  the  basis  factors  are  usually  updated  every  iteration.  The  default  k  is 
reasonable  for  typical  problems.  Higher  values  up  to  k  =  100  (say)  may  be  more  efficient  on 
problems  that  arc  extremely  sparse  and  well  scaled. 

2.  When  the  objective  function  is  nonlinear,  fewer  basis  updates  will  occur  as  an  optimum  is 
approached.  The  number  of  iterations  between  basis  factorizations  will  therefore  increase. 
During  these  iterations  a  test  is  made  regularly  (according  to  the  CHECK  FREQUENCY)  to  ensure 
that  the  general  constraints  are  satisfied.  If  necessary  the  basis  will  be  rcfactorizcd  before 
the  limit  of  k  updates  is  reached. 

3.  When  the  constraints  are  nonlinear,  the  MINOR  ITERATIONS  limit  will  probably  preempt  k. 

FEASIBILITY  TOLERANCE  t  (default t  =  1 .OE-6) 

A  feasible  solution  is  one  in  which  all  variables  satisfy  their  upper  and  lower  bounds  to  within 
the  absolute  tolerance  t.  (This  includes  slack  variables.  Hence,  the  general  linear  constraints  arc 
also  satisfied  to  within  t.) 

1.  MINOS  attempts  to  find  a  feasible  point  before  optimizing  the  objective  function.  If  the  sum 
of  infeasibilities  cannot  be  reduced  to  zero,  the  problem  is  declared  INFEASIBLE.  I*et  SINF 
be  the  corresponding  sum  of  infeasibilities.  If  SINF  is  quite  small,  it  may  be  appropriate  to 
raise  t  by  a  factor  or  10  or  100.  Otherwise,  some  error  in  the  data  should  be  suspected. 

2.  Note:  if  SINF  is  not  small,  there  may  be  other  points  that  have  a  significantly  smaller  sum  of 
infeasibilities.  MINOS  docs  not  attempt  to  find  the  solution  that  minimizes  the  sum. 

3.  If  SCALE  is  used,  feasibility  is  defined  in  terms  of  the  scaled  problem  (since  it  is  then  more 
likely  to  be  meaningful). 

A  nonlinear  objective  function  F(x)  will  be  evaluated  only  at  feasible  points.  If  there  are 
regions  where  F{z)  is  undefined,  every  attempt  should  be  made  to  eliminate  these  regions 
from  the  problem.  For  example,  if  F(x)  =  >Jx\  +  logzj,  it  is  essential  to  place  lower  bounds 
on  both  variables,  ir  FEASIBILITY  TOLERANCE  =  10-6,  the  bounds  z,  >  10~8  and  z*  > 
10-4  might  be  appropriate.  (The  log  singularity  is  more  serious;  in  general,  keep  z  as  far 
away  from  singularities  as  possible.) 

5.  Bounds  should  also  be  used  to  keep  z  more  than  t  away  from  singularities  in  /(*). 

6.  If  there  are  any  nonlinear  constraints,  each  major  iteration  attempts  to  satisfy  their  lineariza¬ 
tion  to  within  the  tolerance  t.  If  this  is  not  possible,  the  bounds  on  the  nonlinear  constraints 
are  relaxed  temporarily  (in  several  stages). 

7.  Feasibility  with  respect  to  the  nonlinear  constraints  themselves  is  measured  against  the  R0V 
TOLERANCE  (not  against  I).  The  relevant  test  is  made  at  the  start  of  a  major  iteration. 
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FUNCTION  PRECISION  tR  (default  £*  =  £0  8) 

The  relative  function  precision  tR  is  intended  to  be  a  measure  of  the  relative  accuracy  with  which 
the  nonlinear  functions  can  be  computed.  For  example,  if  F(x)  is  computed  as  1000.56789  for 
some  relevant  z  and  if  the  first  6  significant  digits  arc  known  to  be  correct,  the  appropriate  value 
for  (R  would  be  1.0E-6. 

(Ideally  the  functions  F(x)  or  /*(z)  should  have  magnitude  of  order  t.  If  all  functions  are 
substantially  less  than  1  in  magnitude,  (R  should  be  the  absolute  precision.  For  example,  if 
F(x)  ==  1 .23456789E-4  at  some  point  and  if  the  first  6  significant  digits  arc  known  to  be  correct, 
the  appropriate  value  for  tR  would  be  1.0E-10.) 

1.  The  default  value  of  tR  is  appropriate  for  simple  analytic  functions. 

2.  In  some  cases  the  function  values  will  be  the  result  of  extensive  computation,  possibly 
involving  an  iterative  procedure  that  can  provide  rather  few  digits  of  precision  at  reasonable 
cost.  Specifying  an  appropriate  FUNCTION  PRECISION  may  lead  to  savings,  by  allowing  the 
linesearch  procedure  to  terminate  when  the  difference  between  function  values  along  the 
search  direction  becomes  as  small  as  the  absolute  error  in  the  values. 

HESSIAN  DIMENSION  r  (default  r  =  SUPERBASICS  LIMIT  or  30) 

This  specifics  that  an  r  X  r  triangular  matrix  It  is  to  be  available  for  use  by  the  quasi-Newton 
algorithm  (to  approximate  the  reduced  Hessian  matrix  according  to  ZTH Z  es  RTR).  Suppose 
there  are  »  superbasic  variables  at  a  particular  iteration. 

1.  If  a  <  r,  the  first  s  columns  of  R  will  be  used  to  approximate  the  reduced  Hessian  in  the 
normal  manner.  If  there  are  no  further  changes  to  the  set  of  superbasic  variables,  the  rate 
of  convergence  will  ultimately  be  superlinear. 

2.  If  s  >  r,  a  matrix  of  the  form 

*-(*■ :) 

will  be  used  to  approximate  the  reduced  Hessian,  where  Rr  is  an  r  X  r  upper  triangular 
matrix  and  D  is  a  diagonal  matrix  of  order  s  —  r.  The  rate  of  convergence  will  no  longer  be 
superlinear. 

3.  The  storage  required  is  of  order  jrs,  which  is  substantia]  if  r  is  as  large  as  200  (say).  In  general, 
r  should  be  a  slight  over-estimate  or  the  final  number  of  superbasic  variables,  whenever  storage 
permits.  It  need  not  be  larger  than  rn  +  1,  where  r»i  is  the  number  of  nonlinear  variables. 
For  many  problems  it  can  be  much  smaller  than  nj. 

4.  If  SUPERBASICS  LIMIT  a  is  specified,  the  default  value  of  r  is  the  same  number,  a  (and 
conversely).  This  is  a  safeguard  to  ensure  superlinear  convergence  wherever  possible.  If 
neither  r  nor  a  is  specified,  both  default  to  the  value  30. 

INSERT  FILE  /  (default  /  =  0) 

If  /  >  0,  this  references  a  file  containing  basis  information  in  the  format  of  section  5.2. 

1.  The  file  will  usually  have  been  output  previously  as  a  PUNCH  file. 

2.  The  file  will  not  be  accessed  if  an  OLD  BASIS  file  is  specified. 


INVERT  FREQUENCY 

See  FACTORIZATION  FREQUENCY. 


28 


3.  The  SPECS  File 


ITERATIONS  LIMIT  k  (default  k  =  3*R0WS  ♦  10*N0NLINEAR  VARS) 

This  is  the  maximum  number  of  minor  iterations  allowed  (i.c.,  iterations  of  the  simplex  method 
or  the  reduced-gradient  algorithm). 

1.  ITNS  is  an  alternative  keyword. 

2.  k  —  0  is  valid,  Hoth  feasibility  and  optimality  are  checked. 

3.  If  CYCLE  LIMIT  >  1,  the  limit  of  k  minor  iterations  applies  to  each  cycle  separately. 


JACOBIAN  DENSE  (default) 

JACOBIAN  SPARSE 

This  determines  the  manner  in  which  the  constraint  gradients  arc  evaluated  and  stored.  It  affects 
the  MI’S  fde  and  subroutine  FUNCON. 

1.  The  DENSE  option  is  convenient  if  there  arc  not  many  nonlinear  constraints  or  variables.  It 
requires  storage  for  three  dense  matrices  of  order  m i  X  nj. 

2.  The  MI’S  file  may  then  contain  any  number  of  Jacobian  entries.  Usually  this  means  no  entries 
at  all. 

3.  For  efficiency,  the  SPARSE  option  is  preferable  in  all  nontrivial  cases.  ( Dcware —  it  must  be 
specifically  requested.)  The  MI’S  file  must  then  specify  the  position  of  all  Jacobian  elements 
(that  are  not  identically  zero),  and  subroutine  FUNCON  must  store  the  elements  of  the  Jacobian 
array  G  in  exactly  the  same  order. 

4.  In  both  cases,  if  DERIVATIVE  LEVEL  =  2  or  3  the  MI’S  file  may  specify  Jacobian  elements 
that  are  constant  for  all  values  of  the  nonlinear  variables.  The  corresponding  elements  of  G 
need  not  be  reset  in  FUNCON. 


LAGRANGIAN  YES  (default) 

LAGRANGIAN  NO 

This  determines  the  form  of  the  objective  function  used  for  the  linearized  subproblems.  The 
default  value  YES  is  Highly  recommended.  The  PENALTY  PARAMETER  value  is  then  also  relevant. 

If  NO  is  specified,  subroutine  FUNCON  will  be  called  only  twice  per  major  iteration.  Hence 
this  option  may  be  useful  if  the  nonlinear  constraint  functions  arc  very  expensive  to  evaluate. 
However,  in  general  there  is  a  great  risk  that  convergence  may  not  occur.  (Note:  FUNCON  will  be 
called  more  often  to  estimate  J(x)  if  DERIVATIVE  LEVEL  <  2.) 


LINESEARCH  DEBUG  AFTER  ITERATION  t  (default  t  =  999999) 

This  causes  considerable  information  to  be  output  by  the  linesearch  procedures  every  iteration, 
once  iteration  ?  has  been  completed.  Its  principal  purpose  is  to  assist  the  authors  of  the  linesearch 
procedures  to  determine  if  the  procedures  arc  functioning  correctly.  In  some  cases  it  may  confirm 
that  the  function  values  are  very  “noisy”,  or  that  the  gradients  computed  in  FUNOBJ  or  FUNCON 
are  incorrect. 
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LINESEARCH  TOLERANCE  t  (default  <  =  0.  l) 

For  nonlinear  problems,  this  controls  the  accuracy  with  which  an  optimum  of  the  merit  function 
will  be  located  along  the  direction  of  search  each  iteration. 

1.  t  must  be  a  real  value  in  the  range  0.0  <  t  <  1.0. 

2.  The  default  value  t  =  0.1  requests  a  moderately  accurate  search.  It  should  be  satisfactory 
for  many  problems. 

3.  If  the  nonlinear  functions  are  cheap  to  evaluate,  a  more  accurate  search  may  be  appropriate; 
try  t  =  0.01  or  t  =  0.001.  The  number  or  iterations  should  decrease,  and  this  will  reduce 
total  run  time  if  there  arc  many  linear  or  nonlinear  constraints. 

4.  If  the  nonlinear  functions  are  expensive  to  evaluate,  a  less  accurate  search  may  be  appropriate. 
If  all  gradients  arc  known,  try  t  =  O.B  or  perhaps  t  =  0.9.  (The  number  of  iterations  will 
probably  increase,  but  the  total  number  of  function  evaluations  may  decrease  enough  to 
compensate.) 

5.  If  not  all  gradients  are  known,  a  reasonably  accurate  search  remains  appropriate.  Each  search 
will  require  only  2-  5  function  values  (typically),  but  many  function  calls  will  then  be  needed 
to  estimate  missing  gradients  for  the  next  iteration. 


LIST  LIMIT  k  (default  k  =  0) 

This  limits  the  number  of  lines  of  the  MTS  file  to  be  listed  on  the  PRINT  file  during  input.  The 
header  cards  (NAME,  ROWS,  COLUMNS,  RHS,  RANGE,  BOUNDS,  ENDATA)  and  comment  cards  will  always 
be  listed,  along  with  their  position  in  the  file. 


LOAD  FILE  /  (default  /  =  0) 

If  /  >  0,  this  references  a  file  containing  basis  information  in  the  format  of  section  5.3. 

1.  The  file  will  usually  have  been  output  previously  as  a  DUMP  file. 

2.  The  file  will  not  be  accessed  if  an  OLD  BASIS  file  or  an  INSERT  file  is  specified. 


LOG  FREQUENCY  k  (default  k  =  l) 

One  line  of  the  iteration  log  will  be  printed  every  fc-th  minor  iteration.  A  value  such  as  k  —  10 
is  suggested  for  those  interested  only  in  the  final  solution. 


LOWER  BOUND  l  (default  /  =  0.0) 

Before  the  BOUNDS  section  of  the  MPS  file  is  read,  all  structural  variables  are  given  the  default 
lower  bound  /.  (Individual  variables  rnay  subsequently  have  their  lower  bound  altered  by  a 
BOUND  set  in  the  MPS  file.) 

1.  LOWER  BOUND  =  1.0E-5  (say)  is  a  useful  method  for  bounding  all  variables  away  from  sin¬ 
gularities  at  zero.  (Explicit  bounds  may  also  be  necessary  in  the  MPS  file.) 

2.  If  all  or  most  variables  arc  to  be  PRICE,  use  LOWER  BOUND  =  -1.0E*20  to  specify  “minus 
infinity”.  (The  default  upper  bound  is  already  1.0E+20,  which  is  treated  a a  “plus  infinity”.) 
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LU  FACTOR  TOLERANCE  *!  (default  tt  =  10. 0) 

LU  UPDATE  TOLERANCE  t3  (default  t s  =  10.0) 

These  tolerances  affect  the  stability  and  sparsity  of  the  basis  factorization  LB  =  U,  during 
refactorization  and  updates  respectively.  Both  tolerances  must  satisfy  tj  >  1.0.  The  matrix  L  is 
a  product  of  matrices  of  the  form 

CO 

where  the  multipliers  fi  will  satisfy  |/z|  <  t+. 

1.  The  default  values  t,  =  10.0  usually  strike  a  good  compromise  between  stability  and  sparsity. 

2.  For  large  and  relatively  dense  problems,  t,  =  25.0  (say)  may  give  a  marked  improvement  in 
sparsity  without  impairing  stability  to  a  serious  degree. 

3.  For  certain  very  special  structures  (e.g.,  band  matrices)  it  may  be  necessary  to  set  tt  in  the 
range  1.0  <  t\  <  2.0  to  achieve  stability. 

MAJOR  ITERATIONS  k  (default  Jfc  =  20) 

This  is  the  maximum  number  of  major  iterations  allowed.  It  is  intended  to  guard  against  an 
excessive  number  of  linearizations  of  the  constraints,  since  in  some  cases  the  sequence  of  major 
iterations  may  not  converge. 

For  preliminary  runs  on  a  new  problem,  a  fairly  low  MAJOR  ITERATIONS  limit  should  be 
specified  (e.g.,  10  or  20).  See  the  advice  given  under  PENALTY  PARAMETER. 


MAXIMIZE 

MINIMIZE  (default) 

This  specifies  the  required  direction  of  optimization.  It  applies  to  both  linear  and  nonlinear  terms 
in  the  objective. 


MINOR  ITERATIONS  *  (default  k  =  40) 

This  is  the  maximum  number  of  iterations  allowed  between  successive  linearizations  of  the  non¬ 
linear  constraints.  A  moderate  value  (e.g.,  10  <  k  <  50)  prevents  excessive  effort  being  expended 
on  early  major  iterations,  but  allows  later  subproblcms  to  be  solved  to  completion. 

In  general  it  is  unsafe  to  specify  a  value  as  small  as  k  =  1  or  2.  (Even  when  an  optimal 
solution  has  been  reached,  a  few  minor  iterations  may  be  needed  for  the  corresponding  subproblem 
to  be  recognized  as  optimal.) 

Note  that  an  independent  limit  on  total  iterations  should  be  specified  oy  the  ITERATIONS 
keyword  as  usual.  If  the  problem  is  linearly  constrained,  this  is  the  only  limit  (i.e.,  the  MINOR 
ITERATIONS  keyword  is  ignored). 


MPS  FILE  /  (default  /  =  ?) 

This  is  the  file  number  for  the  MPS  file.  The  default  value  is  the  system  card  reader  IREAD,  which 
is  often  /  =  5. 

1.  INPUT  FILE  is  a  valid  alternative  keyword. 

2.  For  nontrivial  problems  it  is  usually  best  to  store  the  MPS  file  separately  from  the  SPECS 
file.  If  the  RONS,  COLUMNS  or  ELEMENTS  estimates  prove  to  be  too  low,  MINOS  will  be  able  to 
rewind  the  MPS  file  and  try  again. 
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MULTIPLE  PRICE  k  (default  k  =  l) 

Whenever  a  PRICE  operation  is  performed,  the  k  best  nonbasic  variables  will  be  selected  for 
admission  to  the  supcrbasic  set.  (“nest”  means  the  variables  with  largest  reduced  gradients  of 
appropriate  sign.  If  partial  pricing  is  in  effect,  up  to  k  variables  are  selected  from  the  current 
partition  of  A  and  /.) 

1.  The  default  value  k  =  1  is  best  for  linear  programs,  since  an  optimal  solution  will  have  zero 
supcrbasic  variables. 

2.  Warning :  if  k  >  1,  MINOS  will  go  into  reduced-gradient  mode  even  on  purely  linear  problems. 
The  subsequent  iterations  do  not  correspond  to  the  very  efficient  suboptimization  (“minor 
iterations”)  carried  out  by  standard  linear  programming  systems  using  multiple  pricing. 
(MINOS  varies  all  supcrbasic  variables  simultaneously.  However,  its  storage  requirements 
are  essentially  independent  of  k  on  linear  problems.  Thus,  k  need  not  be  limited  to  B  or  6  as 
it  is  in  standard  systems,  which  require  storage  for  k  dense  vectors  or  dimension  m.) 

3.  On  large  nonlinear  problems  it  may  be  important  to  set  k  >  1,  if  the  starting  point  does 
not  contain  many  supcrbasic  variables.  For  example,  if  a  problem  has  3000  variables  and  500 
of  them  are  nonlinear,  the  optimal  solution  may  well  have  200  variables  supcrbasic.  If  the 
problem  is  solved  in  several  runs,  it  may  be  beneficial  to  use  k  =  10  (say)  for  early  runs, 
until  it  seems  that  the  number  of  supcrbasics  has  levelled  off. 


MEW  BASIS  FILE  /  (default  f  —  0) 

If  /  >  0,  a  basis  map  will  be  saved  on  file  /  every  A:- th  iteration,  where  k  is  the  SAVE  FREQUENCY. 

1.  The  first  card  of  the  file  will  contain  the  word  PROCEEDING  if  the  run  is  still  in  progress. 

2.  If  /  >  0,  a  basis  map  will  also  be  saved  at  the  end  of  a  run,  with  some  other  word  indicating 
the  final  solution  status. 


NONLINEAR 

CONSTRAINTS 

mi 

(default  mi 

=  0) 

NONLINEAR 

VARIABLES 

(default  r»i 

=  0) 

NONLINEAR 

OBJECTIVE  VARIABLES 

ni 

(default  n'| 

=  0) 

NONLINEAR 

JACOBIAN  VARIABLES 

«T 

(default  n'( 

=  0) 

These  keywords  define  the  parameters  M  and  N  in  subroutines  FUN0BJ  and  FUNCON.  For  example, 
M  in  FUNCON  will  take  the  value  mi,  if  mi  >  0. 

1.  If  the  objective  function  and  the  constraints  involve  the  same  set  of  nonlinear  variables  x, 
then  NONLINEAR  VARIABLES  ni  is  the  simplest  way  to  set  N  to  be  the  same  value  for  both 
subroutines. 

2.  Otherwise,  the  NONLINEAR  OBJECTIVE  and  NONLINEAR  JACOBIAN  keywords  should  be  used  to 
specify  n',  and  n'{  separately. 

3.  If  mi  =  0,  the  value  n"  =  0  is  assumed  regardless  of  ni  or  n\. 

4.  Remember  that  the  nonlinear  constraints  and  variables  must  always  be  the  first  ones  in  the 
problem.  It  is  usually  best  to  place  Jacobian  variables  before  objective  variables,  so  that  n'{  < 
n',  (unless  n',  =  0).  This  affects  the  way  the  function  subroutines  should  be  programmed, 
and  the  order  in  which  variables  should  be  placed  in  the  COLUMNS  section  of  the  MPS  file. 
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OBJECTIVE  COST 

This  specifies  the  8-character  name  of  the  type  N  row  in  the  MPS  file  to  be  selected  as  the  linear 
part  of  the  objective  function  (i.e.,  the  objective  function  for  linear  programs). 

1.  If  OBJECTIVE  is  not  specified,  or  if  the  name  is  blank,  the  first  N  row  in  the  ROWS  section 
of  the  MPS  file  will  be  selected.  ( Warning :  objective  rows  must  be  listed  after  nonlinear 
constraint  rows  in  the  ROWS  section  of  the  MI’S  file.) 

2.  If  the  ROWS  section  contains  one  or  more  N  rows  but  you  do  not  want  any  of  them  to  be 
used  in  the  objective  function,  specify  a  dummy  name.  If  the  objective  is  defined  entirely  by 
subroutine  FUNOBJ  it  may  be  helpful  to  specify  OBJECTIVE  =  FUNOBJ.  (However,  don’t  expect 
a  different  name  to  invoke  a  different  subroutine!) 


OLD  BASIS  FILE  /  (default  /  =  0) 

If  /  >  0,  the  starting  point  will  be  obtained  from  this  file  in  the  format  of  section  5.1. 

1.  The  file  will  usually  have  been  output  previously  as  a  NEW  BASIS  FILE. 

2.  The  file  will  not  be  acceptable  if  the  number  of  rows  or  columns  in  the  problem  has  been 
altered. 


OPTIMALITY  TOLERANCE  t  (default t  =  1 .OE-6) 

This  is  used  to  judge  the  size  of  the  reduced  gradients  dy  =  g,  —  xray,  where  g y  is  the  gradient 
of  the  objective  function  corresponding  to  the  j- th  variable,  ay  is  the  associated  column  of  the 
constraint  matrix  (or  Jacobian),  and  x  is  the  set  of  dual  variables. 

1.  By  construction,  the  reduced  gradients  for  basic  variables  are  always  zero.  Optimality  will 
be  declared  if  the  reduced  gradients  for  nonbasic  variables  at  their  lower  or  upper  bounds 
satisfy 

dj/lMI  >  “*  or  <*y/||x||  <  1 

respectively,  and  if 

KI/IMI  < « 

for  superbasic  variables. 

2.  In  the  above  tests,  ||x||  is  a  measure  of  the  size  of  the  dual  variables.  It  is  included  to  make 
the  tests  independent  of  a  scale  factor  on  the  objective  function. 

3.  The  quantity  actually  used  is  defined  by 

*  =  ]C  w» 

t=*t 

||*||  =  ma x{a/y/m,l), 

so  that  only  large  scale  factors  are  allowed  for.  If  the  objective  is  scaled  down  substantially, 
the  test  for  optimality  reduces  to  comparing  just  dy  against  t. 
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PARTIAL  PRICE  p  (default  p  =  1  or  c  (see  below)) 

This  parameter  is  recommended  for  large  problems  that  have  significantly  more  variables  than 
constraints.  It  reduces  the  work  required  for  each  “pricing”  operation  (when  a  nonbasic  variable 
is  selected  to  become  supcrbasic). 

1.  When  p  =  1,  all  columns  of  the  constraint  matrix  (A  /)  are  searched. 

2.  Otherwise,  A  and  I  are  partitioned  to  give  p  roughly  equal  segments  AJt  I}  ( j  =  1  to  p). 
If  the  previous  pricing  search  was  successful  on  Aj_ j,  Ij-\,  the  next  search  begins  on  the 
segments  Aj,  Ij.  (All  subscripts  here  are  modulo  p.)  If  a  reduced  gradient  is  found  that 
is  larger  than  some  dynamic  tolerance,  the  variable  with  the  largest  such  reduced  gradient 
(of  appropriate  sign)  is  selected  to  become  superbasic.  (Several  may  be  selected  if  MULTIPLE 
PRICE  has  been  specified.)  If  nothing  is  found,  the  search  continues  on  the  next  segments 
Aj+  j,  Ij+i,  and  so  on. 

3.  The  default  value  of  p  is  1  for  moderate-sized  problems,  but  may  be  greater  than  1  otherwise. 
A  quantity 

c  =  max{1000,  4*R0WS} 

is  defined.  If  COLUMNS  >  c  and  PARTIAL  PRICE  has  not  been  specified,  p  will  take  the  value 
COLUMNS / 2+RQWS } . 

4.  PARTIAL  PRICE  p  is  recommended  for  time-stage  models  having  p  time  periods. 


PENALTY  PARAMETER  p  (default  p  —  100 . 0/rr»i) 

This  is  the  value  of  p  in  the  modified  augmented  Lagrangian.  It  is  used  only  when  LAGRANGIAN 
=  YES. 

For  early  runs  on  a  problem  with  unknown  characteristics,  something  like  the  default  value 
should  be  specified.  If  the  problem  is  known  to  be  highly  nonlinear,  specify  a  larger  value,  such 
as  10  times  the  default.  In  general,  a  positive  value  of  p  may  be  necessary  to  ensure  convergence, 
even  for  convex  programs. 

On  the  other  hand,  if  p  is  too  large,  the  rate  of  convergence  may  be  unnecessarily  slow.  If 
the  functions  are  not  highly  nonlinear  or  a  good  starling  point  is  known,  it  will  often  be  safe  to 
specify  PENALTY  PARAMETER  0.0. 

If  several  related  problems  are  to  be  solved,  the  following  strategy  for  setting  the  PENALTY 
PARAMETER  may  be  useful: 

1.  Initially,  use  a  moderate  value  of  p,  such  as  the  default,  and  a  reasonably  low  ITERATIONS 
and/or  MAJOR  ITERATIONS  limit. 

2.  If  successive  major  iterations  appear  to  be  terminating  with  radically  different  solutions,  the 
penalty  parameter  should  be  increased.  (See  also  the  DAMPING  PARAMETER.) 

3.  If  there  appears  to  be  little  progress  between  major  iterations,  the  penalty  parameter  could 
be  reduced. 


PHANTOM  COLUMNS  c  (default  c  =  0) 

PHANTOM  ELEMENTS  e  (default  e  =  0) 

See  the  CYCLE  parameters. 
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PIVOT  TOLERANCE  t  (default  t  =  t*) 

This  allows  the  pivot  tolerance  to  be  altered  if  necessary.  (The  tolerance  is  used  to  prevent 
columns  entering  the  basis  if  they  would  cause  the  basis  to  become  almost  singular.)  The  default 
value  of  t  is  roughly  10-u  for  double  precision  on  IBM  systems.  This  should  be  satisfactory  in 
most  circumstances. 


PRINT  LEVEL  (JFLXB)  p  (default  p  =  00001) 

This  varies  the  amount  of  information  that  will  be  output  to  the  printer  file.  It  is  independent 
of  the  LOG  FREQUENCY.  Typical  values  are 

PRINT  LEVEL  1 

which  gives  normal  output  for  linear  and  nonlinear  problems,  and 

PRINT  LEVEL  '  11 

which  in  addition  gives  the  values  of  the  nonlinear  variables  x k  at  the  start  of  each  major  iteration, 
for  problems  with  nonlinear  constraints. 

In  general,  the  value  being  specified  is  best  thought  of  as  a  binary  number  of  the  form 

PRINT  LEVEL  JFLXB 

where  each  letter  stands  for  a  digit  that  is  either  0  or  1.  The  quantities  referred  to  are: 

B  BASIS  statistics,  i.e.,  information  relating  to  the  basis  matrix  whenever  it  is  refactorized. 

X  xk,  the  nonlinear  variables  involved  in  the  objective  function  or  the  constraints. 

L  Xfc,  the  Lagrangc-multiplier  estimates  for  the  nonlinear  constraints.  (Suppressed  if  the 

option  LAGRANGIAN  =  NO  is  specified,  since  X*  =  0  then.) 

F  f(zk)i  the  values  or  the  nonlinear  constraint  functions. 

J  J(x/t) ,  the  Jacobian  matrix. 

To  obtain  output  of  any  item,  set  the  corresponding  digit  to  1,  otherwise  to  0. 

If  J=l,  the  Jacobian  matrix  will  be  output  column-wise  at  the  start  of  each  major  iteration. 
Column  j  will  be  preceded  by  the  value  of  the  corresponding  variable  x}-  and  a  key  to  indicate 
whether  the  variable  is  basic,  superbasic  or  nonbasic.  (Hence  if  J=l,  there  is  no  reason  to  specify 
X=1  unless  the  objective  contains  more  nonlinear  variables  than  the  Jacobian.)  A  typical  line  of 
output  is 

3  1 . 250000D+01  BS  1  1.00000E+00  4  2 . OOOOOE+OO 

which  would  mean  that  x3  is  basic  at  value  12.5,  and  the  third  column  of  the  Jacobian  has 
elements  of  1.0  and  2.0  in  rows  l  and  4. 

PRINT  LEVEL  0  may  be  used  to  suppress  most  output,  including  page  ejects  between  major 
iterations.  (Error  messages  will  not  be  suppressed.)  This  print  level  should  be  used  only  for 
production  runs  on  well  understood  models.  A  high  LOG  FREQUENCY  may  also  be  appropriate  for 
such  cases,  c.g.  100  or  1000.  (For  convenience,  LOG  FREQUENCY  0  may  be  used  as  shorthand  for 
LOG  FREQUENCY  99999.) 

PROBLEM  NUMBER  n  (default  n  =  0) 

For  nonlinear  problems,  this  assigns  a  value  to  the  parameter  NPR0B  in  the  user  subroutines 
FUN0BJ,  FUNC0N  and  MATM0D. 


3.3  SPECS  File  Definitions 


35 


PUNCH  FILE  /  (default  /  =  0) 

If  /  >  0,  the  final  solution  obtained  will  be  output  to  file  /  in  the  format  described  in  section 
5.2.  For  linear  programs,  this  format  is  compatible  with  various  commercial  systems. 

RADIUS  OF  CONVERGENCE  r  (default  r  =  0.01) 

This  determines  when  the  penalty  parameter  p  will  be  reduced  (if  initialized  to  a  positive  value). 
Both  the  nonlinear  constraint  violation  (see  ROWERR  below)  and  the  relative  change  in  consecu¬ 
tive  Lagrange  inultipler  estimates  must  be  less  than  r  at  the  start  of  a  major  iteration  before 
p  is  reduced  or  set  to  zero.  Once  p  is  zero,  the  sequence  of  major  iterations  should  converge 
quadratically  to  an  optimum. 


RANGES  RANGE001 

This  specifies  the  8-character  name  of  the  range  set  to  be  selected  from  the  MI’S  file. 

1.  RNGS  is  a  valid  alternative  keyword. 

2.  If  RANGES  is  not  specified,  or  if  the  name  is  blank,  the  first  range  set  in  the  MPS  file  will  be 
selected. 

3.  If  the  MPS  file  contains  one  or  more  range  sets  but  you  do  not  want  any  of  them  to  be  used, 
specify  a  dummy  name  such  as  RANGES  =  NONE. 

RHS  RHSIDE3 

This  specifies  the  8-character  name  of  the  righthand  side  to  be  selected  from  the  MPS  file. 

1.  If  RHS  is  not  specified,  or  if  the  name  is  blank,  the  first  righthand  side  in  the  MPS  file  will  be 
selected. 

2.  If  the  MPS  file  contains  one  or  more  righthand  sides  but  you  do  not  want  any  of  them  to  be 
used,  specify  a  dummy  name  such  as  RHS  =  NONE. 


ROWS  m  (default  m  =  100) 

This  must  specify  an  over-estimate  of  the  number  of  rows  in  the  constraint  matrix.  It  includes 
the  number  of  nonlinear  constraints  and  the  number  of  general  linear  constraints. 

If  m  proves  to  be  too  small,  MINOS  continues  in  the  manner  described  under  COLUMNS. 

ROW  TOLERANCE  er  (default  er  =  1.0E-8) 

This  specifics  how  accurately  the  nonlinear  constraints  should  be  satisfied.  (TIoth  “ROW”  and 
“TOLE”  are  significant  on  this  data  card.)  Thu  default  value  of  1.0E-6  is  often  appropriate,  since 
the  MPS  file  contains  data  to  about  that  accuracy. 

Let  ROWERR  be  defined  as  the  maximum  component  of  the  residual  vector  /(z)  +  A\y  —  6i, 
normalized  by  the  size  of  the  solution.  Thus, 

ROWERR  =  ||/(x)  +  Aiy  -  MU  / XNORM, 

where  XNORM  is  a  measure  of  the  size  of  the  basic  and  supcrbasic  variables.  The  solution  (z,  y) 
is  regarded  as  acceptably  feasible  if  ROWERR  <  tr. 

If  some  of  the  problem  functions  are  known  to  be  of  low  accuracy,  a  larger  ROW  TOLERANCE 
may  be  appropriate. 


•  I 


36 


3.  The  SPECS  File 


SAVE  FREQUENCY  k  (default  k  =  100) 

If  a  NEW  BASIS  file  has  been  specified,  a  basis  map  describing  the  current  solution  will  be  saved 
on  the  appropriate  file  every  fc-th  iteration.  A  BACKUP  BASIS  file  will  also  be  saved  if  specified. 

SCALE 

SCALE  YES 

SCALE  NO  (default) 

SCALE  TOLERANCE  t  (default  t  =  0.9) 

SCALE,  PRINT 

SCALE,  PRINT.  TOLERANCE  =  t  (default  t  =  0.9) 

All  forms  of  SCALE  (except  NO)  request  that  the  linear  constraints  and  variables  be  scaled  by  an 
iterative  procedure  that  attempts  to  make  the  matrix  coefficients  as  close  as  possible  to  1.0.  This 
will  sometimes  improve  the  performance  of  the  solution  procedures. 

The  printed  solution  and  the  basis  and  solution  files  arc  output  in  original  unsealed  units. 
Scaling  is  therefore  transparent  to  the  user,  except  that  more  storage  is  required  (NB  =  n  +  m 
double  words)  and  precautions  must  be  taken  in  applications  involving  subroutines  MATMOD  and 
MATCOL. 

1.  The  tolerance  t  must  lie  in  the  range  0.0  <  t  <  1.0.  It  affects  how  many  passes  might 
be  needed  through  the  constraint  matrix.  On  each  pass,  the  scaling  procedure  computes  for 
each  column  j  the  ratio  of  the  largest  and  smallest  nonzero  coefficients  in  the  column: 

Pi  =  "«**  |a„|/min|aiy|, 

« («.,  ^  o)  » 

and  records  the  largest  such  ratio,  max3  py.  If  this  is  less  than  t  times  its  previous  value, 
another  scaling  pass  is  performed  to  adjust  the  row  and  column  scales. 

2.  Raising  t  from  0.9  to  0.99  (say)  will  probably  increase  the  number  of  scaling  passes.  At  most 
10  passes  will  be  made. 

3.  If  PRINT  is  specified,  the  row-scales  r(i)  and  column-scales  c(j)  will  be  output  (»'  =  1  to  m, 
j  —  1  to  n).  The  scaled  matrix  coefficients  are 

3l;  =  o,yr(*)/c(», 

and  the  scaled  bounds  on  the  variables  and  slacks  are 

h  =  lAi)>  *i  =  «yc(i)» 

where  c(j)  —  r(j  —  n)  if  j  >  n.  These  sealed  items  arc  stored  permanently  in  place  of  the 
original  data. 

4.  The  scale  factors  for  nonlinear  constraints  and  nonlinear  variables  are  defined  to  be  1.0;  they 
arc  not  printed. 

SOLUTION  YES  (default) 

SOLUTION  NO 

SOLUTION  IF  OPTIMAL,  INFEASIBLE,  or  UNBOUNDED 

SOLUTION  IF  ERROR  CONDITION 

SOLUTION  FILE  /  (default  /  =  0) 

The  first  four  options  determine  whether  the  final  solution  obtained  is  to  be  output  to  the  PRINT 
file.  The  FILE  option  operates  independently;  if  /  >  0,  the  final  solution  will  be  output  to  file  / 
(whether  optimal  or  not). 
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1.  For  the  YES,  IF  OPTIMAL,  and  IF  ERROR  options,  floating-point  numbers  are  printed  in  F16.B 
format,  and  “infinite”  bounds  are  denoted  by  the  word  NONE. 

2.  For  the  FILE  option,  all  numbers  arc  printed  in  1PE16.6  format,  including  “infinite"  bounds 
which  will  have  magnitude  1 .OOOOOOE+20. 

3.  To  sec  more  significant  digits  in  the  printed  solution,  it  will  sometimes  be  useful  to  make  / 
refer  to  the  system  PRINT  file. 


START  OBJECTIVE  CHECK  AT  COLUMN  Ik 
START  CONSTRAINT  CHECK  AT  COLUMN  Ik 
STOP  OBJECTIVE  CHECK  AT  COLUMN/ 

STOP  CONSTRAINT  CHECK  AT  COLUMN/ 

These  keywords  may  be  used  to  abbreviate 
computed  by  subroutines  FUNOBJ  and  FUNCON. 


(default  ik  =  l) 

(default  Ik  =  l) 

(default  /  =  n\) 

(default  /  =  n'{) 

the  verification  of  individual  gradient  elements 
For  example: 


1.  If  the  first  100  objective  gradients  appeared  to  be  correct  in  an  earlier  run,  and  if  you  have 
just  found  a  bug  in  FUNOBJ  that  ought  to  fix  up  the  101-th  component,  then  you  might  as 
well  specify  START  OBJECTIVE  CHECK  AT  COLUMN  101.  Similarly  for  columns  of  the  Jacobian 
matrix. 


2.  If  the  first  100  variables  occur  nonlinearly  in  the  constraints,  and  the  remaining  variables  are 
nonlinear  only  in  the  objective,  then  FUNOBJ  must  set  the  first  100  components  of  G(*)  to 
zero,  but  these  hardly  need  to  be  verified.  The  above  data  card  would  again  be  appropriate. 

These  keywords  arc  effective  if  VERIFY  LEVEL  >  0.  For  an  emergency  verification  at  the  end  of 
a  run,  all  objective  and  constraint  gradients  will  be  checked  if  EMERGENCY  VERIFY  LEVEL  >  0. 


SUBSPACE  TOLERANCE  t  (default  <  —  0.5) 

This  controls  the  extent  to  which  optimization  is  confined  to  the  current  set  of  basic  and  supcrbasic 
variables  (Phase  4  iterations),  before  one  or  more  nonbasic  variables  arc  added  to  the  superbasic 
set  (Phase  3). 

1.  t  must  be  a  real  number  >r  the  range  0.0  <  t  <  1.0.  It  is  used  as  follows. 

2.  When  a  nonbasic  variable  Zy  is  made  superbasic,  the  resulting  norm  of  the  reduced-gradient 
vector  (for  all  superbasics)  is  recorded.  Let  this  be  ||ifTyo||'  (In  fact,  the  norm  will  be  |dy|, 
the  size  of  the  reduced  gradient  for  xy.) 

3.  Subsequent  Phase  4  iterations  will  continue  at  least  until  the  norm  of  the  reduced-gradient 
vector  satisfies  ||Z7j;||  <  t  X  ||/fTyo||.  (||#Ty||  is  the  size  of  the  largest  reduced-gradient 
component  among  the  superbasic  variables.) 

4.  A  smaller  value  of  t  is  likely  to  increase  the  total  number  of  iterations,  but  may  reduce  the 
number  of  basis  changes.  A  larger  value  such  as  t  =  0.9  may  sometimes  lead  to  improved 
overall  efficiency,  if  the  number  of  superbasic  variables  has  to  increase  substantially  between 
the  starling  point  and  an  optimal  solution. 

5.  Other  convergence  tests  on  the  change  in  the  function  being  minimized  and  the  change  in 
the  variables  may  prolong  Phase  4  iterations.  This  helps  to  make  the  overall  performance 
insensitive  to  larger  values  of  t. 
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SUMMARY  FILE  /  (default  /  =  0) 

SUMMARY  FREQUENCY  k  (default  Ik  =  100) 

If  /  >  0,  a  brief  log  will  be  output  to  file  /,  including  one  line  of  information  every  fc-th  iteration. 
In  an  interactive  environment,  it  is  useful  to  direct  this  output  to  the  terminal,  to  allow  a  run  to 
be  monitored  on-line.  (If  something  looks  wrong,  the  run  can  be  manually  terminated.)  Further 
details  are  given  in  section  6.6. 


SUPERBASICS  LIMIT  a  (default  a  =  HESSIAN  DIMENSION,  30.  or  l) 

This  specifies  “how  nonlinear”  you  expect  a  problem  to  be. 

1.  Normally,  a  need  not  be  greater  than  nj  +  1,  where  r* i  is  the  specified  number  of  nonlinear 
variables. 

2.  For  many  problems  (that  arc  not  highly  nonlinear),  a  may  be  considerably  smaller  than  i»j. 
This  will  save  storage  if  nj  is  very  large. 

3.  This  parameter  also  sets  the  HESSIAN  DIMENSION,  unless  the  latter  is  specified  explicitly  (and 
conversely).  If  neither  parameter  is  specified,  both  default  to  the  value  30  (except  if  there 
are  no  nonlinear  variables,  in  which  case  both  default  to  l). 


SUPPRESS  PARAMETERS 

Normally  MINOS  prints  the  SPECS  file  as  it  is  being  read,  and  then  prints  a  complete  list  of  the 
available  keywords  and  their  final  values.  The  SUPPRESS  PARAMETERS  option  tells  MINOS  not  to 
print  the  full  list.  (Both  “SUP”  and  “PARA”  arc  significant.) 


UNBOUNDED  OBJECTIVE  VALUE 
UNBOUNDED  STEP  SIZE 
These  parameters  are  intended 
may  not  achieve  that  purpose!) 


F rna<  (default  Fmax  =  1 . 0E*20) 

am»x  (default  am,x  =  1.0E+10) 

to  detect  unboundedness  in  nonlinear  problems. 
During  a  linescarch  of  the  form 


(They  may  or 


min  F(x  +  ap), 


if  |F|  exceeds  Fmax  or  a  exceeds  amix,  iterations  are  terminated  with  the  exit  message  PROBLEM 
IS  UNBOUNDED  (OR  BADLY  SCALED). 

1.  If  singularities  arc  present,  unboundedness  in  F(x)  may  be  manifested  by  a  floating-point 
overflow  (during  the  evaluation  of  F( i  +  arp))i  before  the  test  against  Fmaa  can  be  made. 

2.  Unboundedness  in  x  is  best  avoided  by  placing  finite  upper  and  lower  bounds  on  the  variables. 
(For  convenience,  this  can  be  accomplished  in  the  SPECS  file;  see  the  LOWER  and  UPPER  BOUND 
parameters.) 


UPPER  BOUND  u  (default  u  =  1 .0E+20) 

Before  the  BOUNDS  section  of  the  MPS  file  is  read,  all  structural  variables  are  given  the  default 
upper  bound  u.  (Individual  variables  may  subsequently  have  their  upper  bound  altered  by  the 
BOUNDS  section  in  the  MI'S  file.) 
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VERIFY  LEVEL 
EMERGENCY  VERIFY  LEVEL 

VERIFY 
VERIFY  LEVEL 

VERIFY  OBJECTIVE  GRADIENTS 
VERIFY  LEVEL 

VERIFY  CONSTRAINT  GRADIENTS 
VERIFY  LEVEL 

VERIFY 

VERIFY 

VERIFY  GRADIENTS 
VERIFY  LEVEL 


l\  (default  l\  =  0) 

lj  (default  /j  =  max(/j,0)) 

NO 

0 

1 

2 

YE8 

3 


These  keywords  refer  to  finite-difference  checks  on  the  gradient  elements  computed  by  the  user 
subroutines  FUNOBJ  and  FUNCON.  It  is  possible  to  specify  VERIFY  LEVELS  0-3  in  several  ways, 
as  indicated  above.  For  example,  the  nonlinear  objective  gradients  (if  any)  will  be  verified  if 
either  VERIFY  OBJECTIVE  or  VERIFY  LEVEL  1  is  specified.  Similarly,  both  the  objective  and 
the  constraint  gradients  will  be  verified  if  VERIFY  YES  or  VERIFY  LEVEL  3  or  just  VERIFY  is 
specified. 

If  0  <  lt  <3,  gradients  will  be  verified  at  the  first  point  reached  that  satisfies  the  linear 
constraints  and  the  upper  and  lower  bounds.  The  current  linearization  of  the  nonlinear  constraints 
must  also  be  satisfied.  If  lj  =0,  only  a  “cheap”  test  will  be  performed,  requiring  3  calls  to  FUNOBJ 
or  2  calls  to  FUNCON.  If  1  <  <  3,  a  more  reliable  check  will  be  made  on  individual  gradient 

components,  within  the  ranges  specified  by  the  START  and  STOP  keywords.  A  key  of  the  form 
“OK”  or  “BAD?”  indicates  whether  or  not  each  component  appears  to  be  correct. 

If  10  <  /t  <  13,  the  action  is  the  same  as  for  lj  —  10,  except  that  it  will  take  place 
immediately  alter  the  first  basis  factorization.  Any  superbasic  variables  will  retain  their  initial 
value  (for  example,  those  specified  with  FX  indicators  in  the  INITIAL  bound  set,  if  no  basis  file  is 
loaded).  This  option  may  be  preferable,  or  even  necessary  if  the  first  set  of  linearized  constraints 
has  no  feasible  solution.  However,  if  the  nonlinear  functions  are  not  well  defined  at  the  first 
(infeasible)  point,  a  fatal  error  may  result. 

An  EMERGENCY  gradient  check  takes  place  at  the  end  of  a  run  if  the  solution  algorithm  is 
unable  to  make  proper  progress.  The  various  levels  /j  =  0-3  have  the  same  meaning  as  for  l\, 
but  the  individual  gradient  checks  are  not  controlled  by  the  START  and  STOP  keywords. 

1.  VERIFY  LEVEL  3  should  be  specified  whenever  a  new  function  routine  is  being  developed. 

2.  Missing  gradients  are  not  checked;  i.e.,  they  result  in  no  overhead. 

3.  The  default  action  is  to  perform  a  cheap  check  on  the  gradients  at  the  first  feasible  point. 

Even  on  debugged  function  routines,  the  message  “GRADIENTS  SEEM  TO  BE  OK”  will  provide 

certain  comfort  at  nominal  expense. 

4.  If  necessary,  checking  can  be  suppressed  by  specifying  VERIFY  LEVEL  >1  and/or  EMERGENCY 

VERIFY  LEVEL  -1. 


j 
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3.  The  SPECS  File 


WEIGHT  ON  LINEAR  OBJECTIVE  w  (default  w  =  0.0) 

This  keyword  invokes  the  so-called  composite  objective  technique,  if  the  first  solution  obtained  is 
infeasible,  and  if  linear  terms  for  the  objective  function  arc  specified  in  the  MPS  file.  While  trying 
to  reduce  the  sum  of  infeasibilities,  the  method  also  attempts  to  optimize  the  linear  objective. 

1.  At  each  infeasible  iteration,  the  objective  function  is  defined  to  be 

minimize  ow(cTx )  +  (sum  of  infeasibilities), 

where  a  =  1  for  MINIMIZE,  <r  =  —  1  for  MAXIMIZE,  and  c  is  the  linear  objective  row. 

2.  If  an  “optimal”  solution  is  reached  while  still  infeasible,  w  is  reduced  by  a  factor  or  10.  This 
helps  to  allow  for  the  possibility  that  the  initial  w  is  too  large.  It  also  provides  dynamic 
allowance  for  the  fact  the  sum  of  infeasibilities  is  tending  towards  zero. 

3.  The  effect  of  w  is  disabled  after  5  such  reductions,  or  if  a  feasible  solution  is  obtained. 

WORKSPACE  (USER)  max*  (default  maxw  =  0) 

WORKSPACE  (TOTAL)  maxz  (default  maxz  =  NWCORE) 

These  keywords  define  the  limits  of  the  region  of  storage  that  MINOS  may  use  in  solving  the 
current  problem.  The  main  work  array  is  declared  in  the  main  program,  along  with  its  length, 
by  statements  of  the  form 

DOUBLE  PRECISION  Z (26000) 

DATA  NWC0RE/250O0/ 

where  the  actual  length  of  Z  must  be  specified  at  compile  time.  The  values  specified  by  the 
WORKSPACE  keywords  are  stored  in 

COMMON  /M2MAPZ/  MAXW. MAXZ. LEN (30) ,L0C(60) 
and  workspace  may  be  shared  according  to  the  following  rules: 

1.  Z(l)  through  Z  (MAXW)  is  available  to  the  user. 

2.  Z(MAXW*1)  through  Z(MAXZ)  is  available  to  MINOS,  and  should  not  be  altered  by  the  user. 

3.  Z(MAXZ+1)  through  Z(NWCORE)  is  unused  (or  available  to  the  user). 

The  arrays  LEN  and  LOC  are  not  used  by  MINOS. 

The  WORKSPACE  parameters  are  most  useful  on  machines  with  a  virtual  (paged)  store.  Some 
systems  will  allow  NWCORE  to  be  set  to  a  very  large  number  (say  600000)  with  no  overhead  in 
saving  the  resulting  object  code.  At  run  time,  when  various  problems  of  different  size  are  to  be 
solved,  it  may  be  sensible  to  confine  MINOS  to  a  portion  of  Z  to  reduce  paging  activity  slightly. 
(However,  MINOS  accesses  storage  contiguously  wherever  possible,  so  the  benefit  may  be  slight. 
In  general  it  is  far  better  to  have  too  much  storage  than  not  enough.) 


4.1  The  NAME  Card 
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4.  THE  MPS  FILE 

An  MPS  file  is  required  for  all  problems  to  specify  names  for  the  variables  and  constraints,  and  to 
define  the  constraints  themselves.  In  contrast  to  the  relatively  free  format  allowed  in  the  SPECS 
file,  a  very  fixed  format  must  be  used  for  the  MPS  file.  (This  means  that  each  item  of  data  must 
appear  in  specific  columns.) 

Various  “header  cards”  divide  the  MI’S  file  into  several  sections  as  follows: 

NAME 

ROWS 

COLUMNS 

RHS 

RANGES  (optional) 

BOUNDS  (optional) 

ENDATA 

Each  header  card  must  begin  in  column  1.  The  intervening  card  images  (indicated  by  above) 
all  have  the  following  data  format: 

Columns  2-3  5-12  15  22  25  36  40  47  50  61 

Contents  Key  NamcO  Namcl  Valucl  Namc2  Value2 

In  addition,  “comment”  cards  arc  allowed;  these  have  an  asterisk  in  column  1  and  any 
characters  in  columns  2-22. 

MPS  format  has  become  the  industry  standard.  Piles  of  this  kind  arc  recognized  by  all 
commercial  mathematical  programming  systems  (including  MPS/360,  MPSX,  MPSX/370  and 
MPS  III  on  IBM  systems;  APEX  III  and  IV  on  CDC  machines;  FMPS  on  Univac  systems;  TEMPO 
on  Burroughs  systems).  They  may  be  created  by  hand,  by  your  own  special- purpose  program,  or 
by  various  commercial  “matrix  generators”,  such  as  GAMMA,  MAGEN  and  OMNI. 

Beware  that  variations  arc  inevitable  in  almost  any  “standard”  format.  Some  restrictions  in 
the  format  accepted  by  MINOS  are  listed  later.  Some  extensions  are  also  needed  for  nonlinear 
problems. 

4.1  The  NAME  Card 

NAME  M0DEL001  (for  example) 

This  card  contains  the  word  NAME  in  columns  1-4,  and  a  name  for  the  problem  in  columns  15-  22. 
(The  name  may  be  from  1  to  8  characters  of  any  kind,  or  it  may  be  blank.)  The  name  is  used  to 
label  the  solution  output,  and  it  appears  on  the  first  card  of  each  basis  file. 

The  NAME  card  is  normally  the  first  card  in  the  MI’S  file,  but  it  may  be  preceded  or  followed 
by  comment  cards. 
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4.  The  MPS  File 


4.2  The  ROWS  Section 

ROWS 
E  FUN01 

G  FUM02  (for  example) 

L  CAPITAL1 
N  COST 

The  general  constraints  are  commonly  referred  to  as  rows.  The  ROWS  section  contains  one  card 
for  each  constraint  (i.e.,  for  each  row).  Key  defines  what  type  the  constraint  is,  and  NamcO  gives 
the  constraint  an  8-character  name.  The  various  row-types  are  as  follows: 

Key  Row- type 

E  = 

G  > 

L  < 

N  Objective 

N  Free 

(The  1-character  Key  may  be  in  column  2  or  column  3.) 

Row-types  E,  G  and  L  are  easily  understood  in  terms  of  a  linear  function  aTx  and  a  right-hand 
side  0.  They  would  be  used  to  specify  constraints  of  the  form 

aTx  =  0,  aTz  >  0  and  aTx  <  0 

respectively.  (Nonzero  elements  of  the  row-vector  a  will  appear  in  appropriate  parts  of  the 
COLUMNS  section,  and  if  0  is  nonzero  it  will  appear  in  the  RHS  section.) 

Row-type  N  stands  for  “Not  binding”,  also  known  as  “Free”.  It  is  used  to  define  the  objective 
row,  and  also  to  prevent  a  constraint  from  actually  being  a  constraint.  (Note  that  — oo  <  aTx  < 
+oo  is  not  really  a  constraint  at  all.  Type  M  rows  are  implemented  by  giving  them  infinite  bounds 
of  this  kind.) 

The  objective  row  is  a  free  row  that  specifies  the  vectors  c  and  d  in  the  objective  function 
F(x)  +  cTx  +  dTy.  It  is  taken  to  be  the  first  free  row,  unless  some  other  free  row  is  specified  by 
the  OBJECTIVE  keyword  in  the  SPECS  file. 

The  ROWS  section  need  not  contain  any  free  rows  if  c  =  d  =  0.  If  there  are  some  nonlinear 
objective  variables,  the  objective  function  will  then  be  F(x)  as  defined  by  subroutine  FUNOBJ. 
Otherwise,  no  objective  function  exists  and  MINOS  will  terminate  at  the  first  point  that  satisfies 
the  constraints. 

If  the  ROWS  section  does  contain  Tree  rows  but  none  of  them  is  intended  to  be  an  objective 
row,  then  some  dummy  name  such  as  OBJECTIVE  =  NONE  should  be  specified  in  the  SPECS  file 
to  prevent  the  first  free  row  from  being  selected.  (If  the  objective  function  is  F(x)  with  no  linear 
terms,  OBJECTIVE  =  FUNOBJ  would  be  a  mnemonic  reminder.) 

Row-names  for  Nonlinear  Constraints 

The  names  of  nonlinear  constraints  must  be  listed  first  in  the  ROWS  section,  and  their  order 
must  be  consistent  with  the  computation  of  the  array  F(*)  in  subroutine  FUNCON. 

In  particular,  the  objective  row  (if  any)  must  appear  after  the  list  or  nonlinear  row  names. 
For  simplicity  we  suggest  that  potential  objective  rows  be  placed  lost: 


4.3  The  COLUMNS  Section 
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ROWS 

G 

FUN01 

nonlinear  constraints  first 

G 

FUN02 

E 

LIN01 

now  linear  constraints 

E 

LIN02 

N 

C0ST01 

objective  rows  last 

N 

C0ST02 

4.S  Th«  COLUMNS  Section 


1  5.  . . . 

.12  15 _ 22 

COLUMNS 

X01 

FUN08 

X01 

R0WO8 

X01 

R0W03 

X02 

FUN02 

X02 

C0ST01 

25 . 30  40 _ 47 

1 . 0  R0W09 

2.5  R0W12 


-11.111111 

1.0 

5.0 


50 . 61  (fields) 


-3.0 

1 . 123456  (example) 


For  each  variable  x}  (say),  the  COLUMNS  section  defines  a  name  for  x}  and  lists  the  nonzero 
entries  al}  in  the  corresponding  column  of  the  constraint  matrix.  The  nonzeros  for  the  first 
column  must  be  grouped  together  before  those  for  the  second  column,  and  so  on.  If  a  column  has 
several  nonzeros,  it  does  not  matter  what  order  they  appear  in  (as  long  as  they  all  appear  before 
the  next  column). 

In  general,  Key  is  blank  (except  for  comments),  NameO  is  the  column  name,  and  Name/, 
Value!  give  a  row  name  and  value  for  some  coefficient  in  that  column.  IT  there  is  another  row 
name  and  value  for  the  same  column,  they  may  appear  as  Natne2,  Va Iuc2  on  the  same  card,  or 
they  may  be  on  the  next  card. 

If  either  Name!  or  .V.imc2  is  blank,  the  corresponding  value  is  ignored. 

Values  are  read  by  MINOS  using  Fortran  formal  E12.0.  This  allows  values  to  be  entered 
in  several  forms;  for  example,  1.2345078,  1 . 2345678E*0,  123.45670E-2  and  12345678E-07  all 
represent  the  same  number.  It  is  usually  best  to  include  an  explicit  decimal  point. 

Beware  that  spaces  within  the  value  fields  are  the  same  as  0’s  (on  most  computer  systems). 
In  particular,  this  means  that  if  an  exponent  like  E-2  appears  then  it  must  be  right-justified  in 
the  value  field.  For  example,  the  two  values 

1 . 23E-02 
1.23E-2 

are  not  the  same  if  the  decimal  point  is  in  column  30  in  both  cases.  The  second  value  is  actually 
1.23E-20. 

In  the  example  above,  the  variable  called  X01  has  5  nonzero  coefficients  in  the  constraints 
named  FUN08,  R0W09,  R0W08,  R0W12  and  R0W03.  The  row  names  and  values  may  be  in  an  arbitrary 
order,  but  they  must  all  appear  before  the  entries  for  column  X02. 

There  is  no  need  to  specify  columns  for  the  slack  variables;  they  are  incorporated  implicitly. 
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4.  The  MI’S  File 


Nonlinear  Variables 

Nonlinear  variables  must  appear  first  in  the  COLUMNS  section,  ordered  in  a  manner  that  is 
consistent  with  the  array  X(*)  in  the  user  subroutines  FUNQBJ  and/or  FUNCON.  In  the  example 

minimize  (2  +  y  +  z)2  +  3z  +  5u> 
subject  to  x3  +  y3  +  z  =2 
x*  +  y*  +  w  =  4 

2x  +  iy  >0 

z  >  0,  w  >  0 

we  have  three  nonlinear  objective  variables  (2,  y,  z),  two  nonlinear  Jacobian  variables  (z,  y),  one 
linear  variable  w,  two  nonlinear  constraints,  one  linear  constraint,  and  some  simple  bounds.  The 
nonlinear  constraints  and  variables  should  always  be  ordered  in  a  similar  way,  at  the  top  left-hand 
corner  of  the  constraint  matrix.  The  latter  is  therefore  of  the  form 

4  =  P*  A') 

\.A2  A  3) 

where  Jk  is  the  Jacobian  matrix.  The  variables  associated  with  Jk  and  A 2  must  appear  first  in 
the  COLUMNS  section,  and  their  order  must  be  consistent  with  the  array  X(*)  in  subroutine 
FUNCON.  Similarly,  entries  belonging  to  Jk  must  appear  in  an  order  that  is  consistent  with  the 
array  G(*)  in  subroutine  FUNCON. 

For  convenience,  let  the  first  n  1  columns  of  the  constraint  matrix  be 

( ^  —  ( Jl  i3  •  •  in'\ 

\A2)  Ui  «2  •••On,/ 

where  jt  is  the  first  column  of  Jk  and  di  is  the  first  column  of  A2.  The  coefficients  of  j\  and 
ai  must  appear  before  the  coefficients  of  j3  and  o2  (and  so  on  lor  all  columns).  Usually,  those 
belonging  to  j\  will  appear  before  any  in  a  1,  but  this  is  not  essential.  (If  certain  linear  constraints 
are  made  nonlinear  at  a  later  date,  this  means  that  entries  in  the  COLUMNS  section  will  not 
have  to  be  reordered.  However,  the  corresponding  row  names  will  need  be  moved  towards  the  top 
of  the  ROWS  section.) 

If  JACOBIAN  =  DENSE,  the  elements  of  Jk  need  not  bp  specified  in  the  MI’S  file.  If  JACOBIAN 
=  SPARSE,  all  nonzero  elements  of  ./*  must  be  specified.  Any  variable  coefficients  should  be  given 
a  dummy  value,  such  as  zero.  These  dummy  entries  identify  the  location  of  the  elements;  their 
actual  values  will  be  computed  later  by  subroutine  FUNCON  or  by  finite  differences. 

If  all  constraint  gradients  are  known  (DERIVATIVE  LEVEL  =  2  or  3),  any  Jacobian  elements 
that  are  constant  m.ay  be  given  their  correct  values  in  the  COLUMNS  section,  and  then  they  need 
not  be  reset  by  subroutine  FUNCON.  This  includes  values  that  are  identically  zero  such  elements 
do  not  have  to  be  specified  anywhere  (in  the  MI’S  file  or  in  FUNCON).  In  other  words,  Jacobian 
elements  are  assumed  to  be  zero  unless  specified  otherwise. 

Note  that  X(*)  need  not  have  the  same  dimension  in  subroutines  FUNOBJ  and  FUNCON  (i.c., 
the  parameter  N  may  differ),  in  the  event  that  different  numbers  are  specified  by  the  NONLINEAR 
OBJECTIVE  and  NONLINEAR  JACOBIAN  keywords.  However  the  shorter  set  of  nonlinear  variables 
must  occur  at  the  beginning  of  the  longer  set,  and  the  ordering  of  variables  in  the  COLUMNS 
section  must  match  both  sets. 

A  nonlinear  objective  function  will  often  involve  variables  that  occur  only  linearly  in  the 
constraints.  In  such  cases  we  recommend  that  the  objective  variables  be  placed  after  the  Jacobian 
variables  in  the  COLUMNS  section,  since  the  Jacobian  will  then  be  as  small  as  possible.  (Sec  the 
variable  z  in  the  example  above.) 


] 

3 

I 


4.5  The  RANGES  Section 
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4.4  The  RHS  Section 


5 . 12 

15. . . .22 

25 . 36 

40. . . .47 

50 . 61 

RHS01 

FUN01 

1.0 

R0WO9 

-3.0 

RHS01 

ROW08 

2.5 

ROW  12 

1.123456 

RHS  01 

R0W03 

-11.111111 

RHS02 

FUN02 

1.0 

RHS02 

FUN04 

5.0 

This  section  specifies  the  elements  of  bt  and  62  ln  (2)-(3).  Together  these  vectors  comprise  what 
is  called  the  right-hand  side.  Only  the  nonzero  coefficients  need  to  be  specified.  They  may  appear 
in  any  order.  The  format  is  exactly  the  same  as  in  the  COLUMNS  section,  with  NameO  giving  a 
name  to  the  right-hand  side. 

If  =  0  and  62  =  0,  the  RHS  header  card  must  appear  as  usual,  but  no  rhs  coefficients  need 
follow. 

The  RHS  section  may  contain  more  than  one  right-hand  side.  The  first  one  will  bi  sed 
unless  some  other  name  is  specified  in  the  SPECS  file. 


4.5  The  RANGES  Section  (Optional) 

1  5 . 12  15 - 22  25. 

ROWS 
E  FUN01 
E  FUN02 
G  CAPITAL1 
L  CAPITAL2 

COLUMNS 


.36  40 _ 47  50 . 61 


RHS01 

FUN01 

4.0 

FUN02 

4.0 

RANGES 

RANGE01 

FUN  01 

1.0 

FUN02 

-1.0 

RANGE01 

CAPITALl 

1.0 

CAPITAL2 

1.0 

Ranges  are  used  for  constraints  of  the  form 

l  <  oTz  <  u, 

where  both  l  and  u  are  finite.  The  range  of  the  constraint  is  r  =  u  —  Either  /  or  u  is  specified 
in  the  RHS  section  (as  b  say),  and  r  is  defined  in  the  RANGES  section.  The  resulting  /  and  u 
depend  on  the  row-type  of  the  constraint  and  the  sign  of  r  as  follows: 


Row-type 

Sign  of  r 

Lower  limit,  l 

Upper  limit,  u 

E 

+ 

b 

*  +  M 

E 

- 

t>-  M 

b 

G 

+  or  — 

6 

*  +  M 

L 

+  or  — 

6  -  Irl 

6 

I 
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4.  The  MPS  File 


The  format  is  exactly  the  same  as  in  the  COLUMNS  section,  with  NamcO  giving  a  name  to 
the  range  set.  The  constraints  listed  above  will  have  the  following  limits: 

4.0  <  FUN01  <  5.0, 

3.0  <  FUN02  <  4.0, 

4.0  <  CAPITAL1  <  5.0, 

3.0  <  CAPITAL 2  <  4.0. 

The  RANGES  section  may  contain  more  than  one  set  of  ranges.  The  first  set  will  be  used 
unless  some  other  name  is  specified  in  the  SPECS  file. 

4.6  The  BOUNDS  Section  (Optional) 


1  B . 12 

BOUNDS 

IS.  .  . 

.22  2B . 

UP  B0UND01 

X01 

4.0 

UP  B0UNDO1 

X02 

4.0 

L0  B0UND01 

X04 

-1.0 

UP  B0UNDO1 

X04 

4.0 

FR  B0UNDO1 

X06 

UP  B0UND01 

X08 

4.0 

The  default  bounds  on  all  variables  xy  (excluding  slacks)  are  0  <  xy  <  oo.  If  necessary,  the 
default  values  0  and  oo  can  be  changed  in  the  SPECS  file  to  /  <  x,  <  u  by  the  LOWER  and  UPPER 
keywords  respectively. 

If  uniform  bounds  of  this  kind  are  not  suitable,  any  number  of  alternative  values  may  be 
specified  in  the  BOUNDS  section.  As  usual,  several  sets  of  bounds  may  be  given,  and  the  first 
set  will  be  used  unless  some  other  name  is  specified  in  the  SPECS  file. 

In  this  section,  Key  gives  the  type  of  bound  required,  SamcO  is  the  name  of  the  bound  set, 
and  Namel  and  Vaiuei  are  the  column  name  and  bound  value.  (,\'a mr'J  and  Va Iuc2  are  ignored.) 

Let  /  and  u  be  the  default  bounds  just  mentioned,  and  let  t  anil  b  be  the  column  and  value 
specified.  The  various  bound-types  allowed  are  as  follows: 


Key 

Bound-type 

Resulting  bounds 

L0 

Lower  bound 

b  <  z  <  u 

UP 

Upper  bound 

l  <  x  <  b 

FX 

Fixed  variable 

b  <  x  <  6  (i 

FR 

Free  variable 

—  oo  <  x  <  +oo 

MI 

Minus  infinity 

—  OO  <  X  <  u 

PL 

Plus  infinity 

l  <  X  <  +00 

The  effect  of  the  examples  above  is  to  give  the  following  bounds: 

l  <  X01  <  4.0 
l  <  X02  <  4.0 
-1.0  <  X04  <  1.0 
-oo  <  X06  <  1.0 

Note  that  types  FR,  MI,  or  PL  should  always  be  used  to  specify  “infinite"  hounds;  they  imply 
values  of  ±1020,  which  are  treated  specially  at  certain  times. 


4.6  The  HOUNDS  Section 
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Nonlinear  Problems 

It  is  often  essential  to  use  bounds  to  avoid  singularities  in  the  nonlinear  functions.  For  example, 
if  an  objective  function  involves  iogij,  a  bound  of  the  form  x}  >  HP4  may  be  necessary  to  avoid 
evaluating  the  objective  function  at  zero  or  negative  values  of  xy  (Subroutine  FUNOBJ  is  usually 
not  called  until  a  feasible  point  has  been  found.  Note  that  x  is  regarded  as  feasible  if  it  satisfies 
its  bounds  to  within  the  FEASIBILITY  TOLERANCE  t.  Thus,  it  would  not  be  safe  to  specify  the 
bound  x j  >  10 "8  if  t  retained  its  default  value  t  =  10-6.) 

Beware  that  subroutine  FUNCON  sometimes  will  be  called  before  the  nonlinear  variables  satisfy 
their  bounds.  If  this  causes  difficulty,  one  approach  is  to  specify  feasible  values  for  the  offending 
variables  in  the  INITIAL  bounds  set  described  next. 

The  INITIAL  Bounds  Set 

The  name  INITIAL  is  reserved  for  a  special  bound  set  that  may  be  used  (optionally)  to  assign 
initial  values  to  any  number  of  the  column  variables.  The  INITIAL  bounds  set  must  appear  after 
any  normal  bound  sets  (if  any).  A  warning  is  given  if  it  is  the  first  set  encountered  after  the 
BOUNDS  card. 

All  bound  types  except  FR  have  a  meaning.  In  the  example 


FX 

INITIAL 

XI 

1.0 

L0 

INITIAL 

X2 

2.0 

UP 

INITIAL 

X3 

3.0 

MI 

INITIAL 

Yl 

PL 

INITIAL 

Y2 

suppose  that  the  five  variables  have  already  been  given  the  upper  and  lower  bounds  0.0  < 
XI,  X2,  X3,  Yl,  Y2  <  5.0.  The  initial  basis  and  the  starting  point  will  then  be  affected  as  follows: 

1.  XI  will  be  made  superbasic  at  the  value  1.0. 

2.  X2  will  initially  be  made  non  basic  at  its  lower  bound,  but  if  it  is  involved  in  the  nonlinear 
constraints,  it  will  have  the  value  2.0  when  subroutine  FUNCON  is  called  for  the  first  time. 

3.  X3  will  initially  be  made  nonbasic  at  its  upper  bound,  but  if  it  is  involved  in  the  nonlinear 
constraints,  it  will  have  the  value  3.0  when  subroutine  FUNCON  is  called  Tor  the  first  time. 

4.  Yl  will  initially  be  made  nonbasic  at  its  lower  bound,  and  its  initial  value  will  be  that  bound 
(0.0  in  this  case). 

5.  Y2  will  initially  be  made  nonbasic  at  its  upper  bound,  and  its  initial  value  will  be  that  bound 
(5.0  in  this  case). 

The  key  FX  should  be  used  if  good  starting  values  are  known,  particularly  for  nonlinear 
variables.  However,  this  should  not  be  at  the  expense  of  forming  a  very  large  set  of  superbasic 
variables,  if  the  optimal  solution  is  likely  to  contain  only  a  Tew.  If  the  number  of  FX  entries  has 
reached  the  SUPERBASICS  LIMIT,  any  further  FX  will  be  treated  as  L0  or  UP,  depending  on  which 
bound  is  closer  to  the  specified  numerical  value. 

Variables  that  arc  not  specified  in  the  INITIAL  bounds  set  will  initially  be  nonbasic  at  their 
lower  or  upper  bounds  (whichever  is  smaller  in  absolute  value),  or  at  zero  if  a  variable  is  free. 

In  this  context,  variables  that  are  initially  nonbasic  may  be  selected  by  the  CJtA.SII  procedure 
to  become  basic,  in  which  case  their  initial  values  arc  unpredictable.  If  this  arbitrariness  sounds 
troublesome,  use  one  of  the  CRASH  OPTIONS  to  prevent  various  sets  of  variables  from  being  chosen 
for  the  initial  basis. 
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4.  The  MPS  File 


As  with  normal  bound  sets,  variables  may  be  listed  in  any  order.  (For  each  entry  a  linear 
search  is  made  through  the  column  names,  starting  at  the  name  on  the  previous  entry.  Thus,  for 
large  problems  it  helps  to  Follow  the  order  of  the  variables  in  the  COLUMNS  section,  at  least  to 
some  extent.) 

The  INITIAL  bounds  set  is  ignored  if  a  basis  file  is  supplied. 

4.7  Comment  Cards 

Any  card  in  the  MPS  file  may  contain  an  asterisk  in  column  1  and  arbitrary  data  in  columns 
2-22.  Such  cards  will  be  treated  as  comments.  They  will  appear  in  the  printer  listing  but  will 
otherwise  be  ignored. 

Note  that  comment  cards  are  input  as  if  they  were  genuine  data  in  each  section  of  the  MPS 
file.  Thus,  columns  25-36  and  50-61  should  preferably  be  blank.  If  not,  they  should  contain  valid 
numerical  data  whenever  non-comment  cards  would  do  so.  (This  is  a  limitation  of  ANSI  1966 
Standard  Fortran;  data  cannot  be  read  under  one  format  and  then  re-read  under  another.) 

4.8  Restrictions  and  Extensions  in  MPS  Format 

1.  Blanks  are  significant  in  the  8-character  name  fields.  We  recommend  that  all  names  be  left- 
justified  with  no  imbedded  blanks.  In  particular,  names  referred  to  in  the  SPECS  file  must 
be  left-justified  in  the  MPS  file;  for  example,  OBJECTIVE  =  C0ST02  specifies  an  8-character 
name  whose  last  two  characters  are  blank. 

2.  Comments  ideally  should  use  only  columns  1-22  as  noted  above. 

3.  Scale  factors  cannot  be  entered  in  the  ROWS  section. 

4.  It  does  not  matter  if  there  is  no  row  of  type  N. 

5.  There  must  be  at  least  one  row  in  the  ROWS  section,  even  for  problems  with  no  general 
constraints.  (It  may  have  row-type  N.) 

6.  Nonlinear  constraints  must  appear  before  linear  constraints  in  the  ROWS  section. 

7.  Markers  such  as  INTORG  and  INTEND  arc  not  recognized  in  the  COLUMNS  section. 

8.  Numerical  values  may  be  entered  in  E  or  F  format.  Spaces  within  the  12-character  fields  arc 
treated  as  if  they  were  0’s. 

9.  Nonlinear  variables  must  appear  before  linear  variables  in  the  COLUMNS  section. 

10.  If  RANGES  and  BOUNDS  sections  are  both  present,  the  RANGES  section  must  appear  first. 

1 1.  In  the  BOUNDS  section,  if  an  UP  entry  specifics  a  zero  upper  bound,  the  corresponding  lower 
bound  is  not  affected.  (Bcware--in  some  MP  systems,  the  lower  bound  is  converted  to  — oo.) 

12.  The  bounds  name  INITIAL  has  a  special  meaning. 


5.1  NEW  and  OLD  BASIS  Files 
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5.  BASIS  Fil«« 


For  non-trivial  problems,  it  is  advisable  to  save  a  DASIS  file  at  the  end  of  a  run,  in  order  to 
restart  the  run  if  necessary,  or  to  provide  a  good  starting  point  for  some  closely  related  problem. 

Three  formats  are  available  for  saving  basis  descriptions.  They  are  invoked  by  SPECS  cards 
of  the  following  form: 


NEW  BASIS 

FILE 

10 

BACKUP 

FILE 

11 

PUNCH 

FILE 

20 

DUMP 

FILE 

30 

(same  as  NEW  BASIS  but  on  a  different  file) 


The  file  numbers  may  be  whatever  is  convenient,  or  zero  for  files  that  are  not  wanted. 

NEW  BASIS  and  BACKUP  files  are  saved  every  k-th  iteration,  in  that  order,  where  Jfc  is  the 
SAVE  FREQUENCY. 

NEW,  PUNCH  and  DUMP  files  are  saved  at  the  end  of  a  run,  in  that  order.  They  may 
be  re-loaded  at  the  start  of  a  subsequent  run  by  specifying  SPECS  cards  of  the  following  form 
respectively: 

OLD  BASIS  FILE  10 

INSERT  FILE  20 

LOAD  FILE  30 

Only  one  such  file  will  actually  be  loaded.  If  more  than  one  positive  file  number  is  specified,  the 
order  of  precedence  is  as  shown.  If  no  BASIS  files  are  specified,  one  of  the  CRASH  OPTIONS  takes 
effect. 

Figures  5. 1-5.3  illustrate  the  data  formats  used  for  BASIS  files.  80-character  fixed-length 
records  are  suitable  in  all  cases.  (36-character  records  would  be  adequate  for  PUNCH  and  DUMP 
files.)  The  files  shown  correspond  to  the  optimal  solution  for  the  economic-growth  model  MANNE, 
described  in  section  8.4.  Selected  column  numbers  arc  included  to  define  significant  data  fields. 
The  problem  has  10  nonlinear  constraints,  10  linear  constraints,  and  30  variables. 


6.1  NEW  and  OLD  BASIS  Files 

We  sometimes  call  these  files  basis  maps.  They  contain  the  most  compact  representation  of  the 
state  of  each  variable.  They  are  intended  for  restarting  the  solution  of  a  problem  at  a  point 
that  was  reached  by  an  earlier  run  on  the  same  problem  or  a  related  problem  with  the  same 
dimensions.  (Perhaps  the  ITERATIONS  LIMIT  was  previously  too  small,  or  some  other  objective 
row  is  to  be  used.) 

As  illustrated  in  Figure  5.1,  the  following  information  is  recorded  in  a  NEW  BASIS  file. 

1.  A  card  containing  the  problem  name,  the  iteration  number  when  the  file  was  created,  the 
status  of  the  solution  (OPTIMAL  S0LN,  INFEASIBLE,  UNBOUNDED,  EXCESS  ITNS,  ERROR  C0NDN, 
or  PROCEEDING),  the  number  of  infeasibilities,  and  the  current  objective  value  (or  the  sum  of 
infeasibilitics). 

2.  A  card  containing  the  OBJECTIVE,  RHS,  RANGES  and  BOUNDS  names,  M  =  the  number  of  rows 
in  the  constraint  matrix,  N  =  the  number  of  columns  in  the  constraint  matrix,  and  SB  =  the 
number  of  supcrbasic  variables. 
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5.  BASIS  Files 


3.  A  set  of  (N  +  II  -  l)/80  +  1  cards  indicating  the  state  of  the  N  column  variables  and  the  U 
slack  variables  in  that  order.  One  character  HS(j>)  is  recorded  for  each  j  =  1, 2, . . . ,  N  4-  II  as 
follows,  written  with  FORMAT (8011). 

HS  O')  State  of  the  j-th  variable 

0  Nonbasic  at  lower  bound 

1  Nonbasic  at  upper  bound 

2  Superbasic 

3  Basic 

If  variable  j  is  fixed  {lower  bound  =  upper  bound),  then  HS(j)  may  be  0  or  1.  The  same 
is  true  if  variable  j  is  free  (infinite  bounds)  and  still  nonbasic,  although  free  variables  will 
almost  always  be  basic. 

4.  A  set  of  cards  of  the  form 

3  xi 

written  with  FORMAT  (18.  1PE24. 14)  and  terminated  by  an  entry  with  j  =  0,  where  j  denotes 
the  j-th  variable  and  x,  is  a  real  value.  The  jr-th  variable  is  either  the  j-th  column  or  the 
(j  —  M)-th  slack,  if  j  >  N.  Typically,  HS(j)  =  2  (superbasic).  When  nonlinear  constraints  are 
present,  this  list  of  superbasic  variables  is  extended  to  include  all  basic  nonlinear  variables. 
The  Jacobian  matrix  can  then  be  reconstructed  exactly  Tor  a  restart. 

Loading  a  NEW  BASIS  file 

A  file  that  has  been  saved  as  an  OLD  BASIS  file  may  be  input  at  the  beginning  of  a  later  run  as 
a  NEW  BASIS  file.  The  following  notes  are  relevant: 

1.  The  first  card  is  input  and  printed  but  otherwise  not  used. 

2.  The  values  labelled  M  and  N  on  the  second  card  must  agree  with  those  for  the  MPS  file  that 
has  just  been  read.  The  value  labelled  SB  is  input  and  printed  but  is  not  used. 

3.  The  next  set  of  cards  must  contain  exactly  M  values  HS(j)  =  3,  denoting  the  basic  variables. 

4.  The  list  of  j  and  x y  values  must  include  an  entry  for  every  variable  whose  state  is  HSfj)  =  2 
(the  superbasic  variables). 

5.  Further  j  and  zy  values  may  be  included,  in  any  order. 

6.  For  any  j  in  this  list,  if  HS(j)  =  3  (basic),  the  value  xy  will  be  recorded  for  nonlinear 
variables,  but  the  variable  will  remain  basic. 

7.  If  HS(j)  3,  variable  j  will  be  initialized  at  the  value  zy  and  its  state  will  be  reset  to  2 
(superbasic).  If  the  number  of  superbasic  variables  has  already  reached  the  SUPERBASICS 
LIMIT,  then  variable  j  will  be  made  nonbasic  at  the  bound  nearest  to  zy  (or  at  zero  if  it  is  a 
free  variable). 


5.1  NEW  and  OLD  BASIS  Files 
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57 . 50 

OBJ  -2.6700976576430  00 
M=  20  N«  30  SB-  7 

032222222303333333333333333331 1 1 1 1 1 1 1 11 1 0000000000 

3  3.214430306546170  00 

4  3.304004540903450  00 

5  3.395219957011400  00 

6  3.457575205733720  00 

7  3.551722961654240  00 

5  3.676425591145790  00 

9  3.771562557441020  00 

1  3.050000000000000  00 

2  3.126650351567580  00 

10  3.566666666666670  00 

11  9.500000000000000-01 

12  9.654180635592470-01 

13  9.976010109641690-01 

14  1.025200569133170  00 

15  1.059670152206730  00 

16  1.092272226137000  00 

17  1.126076354918100  00 

18  1.161163956085100  00 

19  1.197628149454330  00 

20  1.213943080245590  00 

0 

1 . 8  12 . 32 


1 . 8  15 . 23  29 . 40  43 - 50 

NAME  10  XTN  11  OPTIMAL  SOLN  NINP  0 

08J-FUN0BJ  RHSsRHS  RNS*RANSC1  SNOWBOUND! 


Figure  5.1.  Format  of  NEW  and  OLD  BASIS  file# 


Warning:  This  format  is  not  quite  compatible  with  MINOS  4.0  in  the  following  respects. 

1.  On  the  second  card,  II  is  the  number  of  constraints  (m,  as  before)  but  N  is  now  the  number 
of  variables  excluding  slacks  (i.e.,  n,  the  number  of  columns  in  the  MPS  file  plus  the  number 
of  phantom  columns,  if  any).  Previously,  N  had  the  value  n  +  1  +  m;  this  included  1  for  the 
right-hand  side  and  m  for  the  slacks. 

2.  The  basis  map  starting  at  card  3  docs  not  contain  an  entry  for  the  right-hand  side,  which 
was  previously  in  position  n  +  1.  The  length  of  the  map  is  now  n  +  m,  not  n  +  1  +  m. 

3.  In  the  list  of  (j  x}  )  entries,  the  values  of  j  referring  to  slacks  arc  now  one  less  than  before. 
(These  are  entries  for  which  j  >  n.) 

A  basis  map  from  MINOS  4.0  can  therefore  be  converted  to  the  present  format  with  reasonable 
ease.  PUNCH  and  DUMP  files  from  MINOS  4.0  should  be  acceptable  as  INSERT  and  LOAD  files 
without  change. 
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5.  BASIS  Files 


5.2  PUNCH  and  INSERT  File* 

These  hies  provide  compatibility  with  commercial  mathematical  programming  systems.  The 
PUNCH  hie  from  a  previous  run  may  be  used  as  an  INSERT  File  for  a  later  run  on  the  same 
problem.  It  may  also  be  possible  to  modify  the  INSERT  file  and/or  problem  and  still  obtain  a 
useful  advanced  basis. 

The  standard  MPS  format  has  been  slightly  generalized  to  allow  the  saving  and  reloading  of 
nonbasic  solutions.  It  is  illustrated  in  Figure  5.2.  Apart  from  the  first  and  last  card,  each  entry 
has  the  following  form: 

Columns  2-3  5-12  15-22  25-36 

Contents  Key  Namel  Name2  Value 

The  various  keys  are  best  defined  in  terms  of  the  action  they  cause  on  input.  It  is  assumed  that 
the  basis  is  initially  set  to  be  the  full  set  of  slack  variables,  and  that  column  variables  are  initially 
at  their  smallest  bound  in  absolute  magnitude. 

Key  Action  to  be  taken  during  INSERT 

XL  Make  variable  Namel  basic  and  slack  Name2  nonbasic  at  its  lower  bound. 

XU  Make  variable  Namel  basic  and  slack  Name2  nonbasic  at  its  upper  bound. 

LL  Make  variable  Namel  nonbasic  at  its  lower  bound. 

UL  Make  variable  Namel  nonbasic  at  its  upper  bound. 

SB  Make  variable  Namel  superbasic  at  the  specified  Value. 

Note  that  Namel  may  be  a  column  name  or  a  row  name,  but  (on  XL  and  XU  cards)  Namc2  must 
be  a  row  name.  In  all  cases,  row  names  indicate  the  associated  slack  variable,  and  if  Namel  is 
a  nonlinear  variable  then  its  Value  is  recorded  for  possible  use  in  defining  the  initial  Jacobian 
matrix. 

The  key  SB  is  an  addition  to  the  standard  MPS  format  to  allow  for  nonbasic  solutions. 


Notes  on  PUNCH  Data 

1.  Variables  are  output  in  natural  order.  For  example,  on  the  first  XL  or  XU  card,  Namel  will  be 
the  first  basic  column  and  Name2  will  be  the  first  row  whose  slack  is  not  basic.  (The  slack 
could  be  nonbasic  or  superbasic.) 

2.  LL  cards  are  not  output  for  nonbasic  variables  if  the  corresponding  lower  bound  value  is  zero. 

3.  Superbasic  slacks  are  output  last. 

4.  PUNCH  and  INSERT  files  deal  with  the  status  and  values  of  slack  variables.  This  is  in 
contrast  to  the  printed  solution  and  the  SOLUTION  file,  which  deal  with  rows. 

Notes  on  INSERT  Data 

1.  Before  an  INSERT  file  is  read,  column  variables  arc  made  nonbasic  at  their  smallest  bound 
in  absolute  magnitude,  and  the  slack  variables  are  made  basic. 

2.  Preferably  an  INSERT  file  should  be  an  unmodified  PUNCH  file  from  an  earlier  run  on  the 
same  problem.  If  some  rows  have  been  added  to  the  problem,  the  INSERT  file  need  not  be 
altered.  (The  slacks  for  the  new  rows  will  be  in  the  basis.) 


5.3  DUMP  and  LOAD  Files 
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3.  Entries  will  be  ignored  if  Namel  is  already  basic  or  superbasic.  XL  and  XU  cards  will  be 
ignored  if  Name2  is  not  basic. 

4.  SB  cards  may  be  added  before  the  ENDATA  card,  to  specify  additional  superbasic  columns  or 
slacks. 

5.  An  SB  card  will  not  alter  the  status  of  Name 1  if  the  SUPERBASICS  LIMIT  has  been  reached. 
However,  the  associated  Value  will  be  retained  if  Namel  is  a  Jacobian  variable. 

5.3  DUMP  and  LOAD  Files 

These  files  are  similar  to  PUNCH  and  INSERT  files,  but  they  record  solution  information  in 
a  manner  that  is  more  direct  and  more  easily  modified.  In  particular,  no  distinction  is  made 
between  columns  and  slacks.  Apart  from  the  first  and  last  card,  each  entry  has  the  form 

Columns  2-3  5-12  25-36 

Contents  Key  Name  Value 

as  illustrated  in  Figure  5.3.  The  keys  LL,  UL,  BS  and  SB  mean  Lower  Limit,  Upper  Limit,  Basic 
and  Superbasic  respectively. 

Notes  on  DUMP  Data 

1.  A  card  is  output  for  every  variable,  columns  followed  by  slacks. 

2.  Nonbasic  free  variables  will  be  output  with  either  LL  or  UL  keys  and  with  Value  zero. 

Notes  on  LOAD  Data 

1.  Before  a  LOAD  file  is  read,  all  columns  and  slacks  are  made  nonbasic  at  their  smallest  bound 
in  absolute  magnitude.  The  basis  is  initially  empty. 

2.  Each  LL,  UL  or  BS  card  causes  Name  to  adopt  the  specified  status.  The  associated  Value  will 
be  retained  if  Name  is  a  Jacobian  variable. 

3.  An  SB  card  causes  Name  to  become  superbasic  at  the  specified  Value. 

4.  An  entry  will  be  ignored  if  Name  is  already  basic  or  superbasic.  (Thus,  ordy  the  first  BS  or 
SB  card  takes  effect  for  any  given  Name.) 

5.  An  SB  card  will  not  alter  the  status  of  Name  if  the  SUPERBASICS  LIMIT  has  been  reached, 
but  the  associated  Value  will  be  retained  if  Name  is  a  Jacobian  variable. 

6.  ( Partial  basis )  Let  M  be  the  number  of  rows  in  the  problem.  If  fewer  than  M  variables  arc 
specified  to  be  basic,  a  tentative  basis  list  will  be  constructed  by  adding  the  requisite  number 
of  slacks,  starting  from  the  first  row  and  taking  those  that  were  not  previously  specified  to 
be  basic  or  superbasic.  (If  the  resulting  basis  proves  to  be  singular,  the  basis  factorization 
routine  will  replace  a  number  of  basic  variables  by  other  slacks.)  The  starting  point  obtained 
in  this  way  will  not  necessarily  be  “good”. 

7.  (Too  many  basics)  If  M  variables  have  already  been  specified  as  basic,  any  further  BS  keys  will 
be  treated  as  though  they  were  SB.  This  feature  may  be  useful  for  combining  solutions  to 
smaller  problems. 
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1  S . It 

15.. ..22 

» . 34 

1 

5 . 12 

15.. ..22 

25 . 36 

NAME 

MUM  It 

PUNCH /INSERT  i 

NAME 

MUM  tO 

DUMP/ LOAD 

U  KAP001 

3.050000  00 

LL 

KAPOOt 

3.050000  00 

XU  KAP002 

noNoot 

3.124450  00 

83 

KAP002 

3.126650  00 

38  KAP003 

3.214430  00 

38 

KAP003 

3.214430  00 

SB  KAPOOt 

3.304000  00 

SB 

KAP004 

3.304000  00 

SB  KAP005 

3.395220  00 

SB 

KAP005 

3.395220  00 

SB  KAPOOt 

3.487080  00 

SB 

KAP006 

3.487080  00 

38  KAP007 

3.581720  00 

SB 

KAPQ07 

3.581720  00 

SB  KAP008 

3.474430  00 

SB 

KAP008 

3.476430  00 

38  XANII 

3.771500  00 

SB 

KAPOOt 

3.771500  00 

XU  KAPOIO 

HONOOt 

3.866470  00 

83 

KAPOIO 

3.866670  00 

LL  CQN001 

9.500000-01 

LL 

CONOOI 

9.500000-01 

XU  CONC02 

H0N003 

9.684100-01 

83 

CQN002 

9.684100-01 

XU  C8N003 

HONOOt 

9.978010-01 

83 

CQN003 

9.978010-01 

XU  CCN004 

MONO 05 

1.020200  00 

83 

CON004 

1.028200  00 

XU  CON005 

honooa 

I.05967D  00 

83 

CONOOS 

1.0596 70  00 

XU  CSN004 

H0N007 

1.092270  00 

83 

CON004 

1.092270  00 

XU  CQN007 

MONO  OS 

1.126080  00 

83 

C0N007 

1.126000  00 

XU  CDN008 

HONOOt 

1. 141160  00 

83 

CONOOO 

1.161160  00 

XU  CONOOt 

NONOIO 

1.197630  00 

83 

C0N009 

1.197630  00 

XL  CCN010 

CAPOOt 

1.213940  00 

83 

CONOIO 

1.213940  00 

XL  INV001 

CAPO03 

7.665040-02 

83 

INVOOt 

7.665040-02 

XL  INVOOt 

CAPO 0 A 

8.770000-02 

83 

INVOOt 

8.778000-02 

XL  IMV003 

CAP005 

8.957420-02 

83 

ZNV003 

8.957420-02 

XL  INVOOt 

CAPO 04 

9.121540-02 

83 

INV804 

9.121540-02 

XL  INV005 

CAPO 07 

9.265820-02 

83 

INV005 

9.265820-02 

XL  INV004 

CAPO 08 

9.384400-02 

63 

INV004 

9.384400-02 

XL  INV007 

CAPOOt 

9.470540-02 

83 

INVOOT 

9.470560-02 

XL  INV008 

CAPO  10 

9.515400-02 

83 

INV008 

9.515400-02 

XL  INVOOt 

TCTWNV 

9.508410-02 

83 

INVOOt 

9.508410-02 

UL  INVOIO 

1.140000-01 

UL 

INVOIO 

1.160000-01 

©SATA 

UL 

H0N001 

0.000000-01 

UL 

HONOOt 

0.000000-01 

UL 

MONO  03 

0.000000-01 

UL 

MONO 04 

0.000000-01 

Fleur#  S.3.  Format  of  PUNCH  and  INSERT  Urn 

UL 

HON005 

0. 000000-01 

UL 

HON004 

0.000000-01 

UL 

H0N007 

0.000000-01 

UL 

H0N008 

0.000000-01 

UL 

HONOOt 

o.oooooo-ot 

UL 

M0N010 

0.000000-01 

LL 

CAP002 

0.000000-01 

LL 

CAP003 

0.000000-01 

LL 

CAPOOt 

0.000000-01 

LL 

CAP005 

0.000000-01 

LL 

CAPOOt 

0.000000-01 

LL 

CAP007 

0. 000000-01 

LL 

CAP008 

0.000000-01 

LL 

CAPOOt 

o.oooooo-ot 

LL 

CAP010 

0.000000-01 

LL 

TtRHINV 

0.000000-01 

©oata 


Figure  l.l.  Format  of  DUMP  and  LOAD  files 
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6.4  Restarting  Modified  Problems 

Sections  5. 1-5.3  document  three  distinct  starting  methods  (OLD  BASIS,  INSERT  and  LOAD 
files),  which  may  be  preferable  to  any  of  the  cold  start  (CRASH)  options.  The  best  choice  depends 
on  the  extent  to  which  a  problem  has  been  modified,  and  whether  it  is  more  convenient  to  specify 
variables  by  number  or  by  name.  The  following  notes  offer  some  rules  of  thumb. 

Protection 

In  general  there  is  no  danger  of  specifying  infinite  values.  For  example,  if  a  variable  is  specified 
to  be  nonbasic  at  an  upper  bound  that  happens  to  be  +  oo,  it  will  be  made  nonbasic  at  its  lower 
bound.  Conversely  if  its  lower  bound  is  — oo.  If  the  variable  is  free  (both  bounds  infinite),  it  will 
be  made  nonbasic  at  value  zero.  No  warning  message  will  be  issued. 

Default  Status 

If  the  status  of  a  variable  is  not  explicitly  given,  it  will  initially  be  nonbasic  at  the  bound  that  is 
smallest  in  absolute  magnitude.  Ties  arc  broken  in  favor  of  lower  bounds,  and  free  variables  will 
again  take  the  value  zero. 

Restarting  with  Different  Bounds 

Suppose  that  a  problem  is  to  be  restarted  after  the  bounds  on  some  variable  X  have  been  altered. 
Any  of  the  basis  files  may  be  used,  but  the  starting  point  obtained  depends  on  the  status  of  X  at 
the  time  the  basis  is  saved. 

RX  is  basic  or  superbasic,  the  starting  point  will  be  the  same  as  before  (all  other  things  being 
equal).  The  value  of  X  may  lie  outside  its  new  set  of  bounds,  but  there  will  be  minimal  loss  of 
feasibility  or  optimality  for  the  problem  as  a  whole. 

If  X  was  previously  fixed,  it  is  likely  to  be  nonbasic  at  its  lower  bound  (which  happens  to  be 
the  same  as  its  upper  bound).  Increasing  its  upper  bound  will  not  affect  the  solution. 

In  contrast,  if  X  is  nonbasic  at  its  upper  bound  and  if  that  bound  is  altered,  the  starting  values 
for  an  arbitrary  number  of  basic  variables  could  be  changed  (since  they  will  be  recomputed  from 
the  nonbasic  and  superbasic  variables).  This  may  not  be  of  great  consequence,  but  sometimes  it 
may  be  worthwhile  to  retain  the  old  solution  precisely.  To  do  this,  one  must  make  X  superbasic 
at  the  original  bound  value. 

For  example,  if  X  is  nonbasic  at  an  upper  bound  of  5.0  (which  has  now  been  changed),  one 
should  insert  a  card  of  the  form 

j  5.0 

near  the  end  of  an  OLD  BASIS  file,  or  the  card 
SB  X  5.0 

near  the  end  of  an  INSERT  or  LOAD  file.  Note  that  the  SPECS  file  must  specify  a  SUPERBASICS 
LIMIT  at  least  as  large  as  the  number  of  variables  involved,  even  for  purely  linear  problems. 

Sequences  of  Problems 

Whenever  practical,  a  scries  of  related  problems  should  be  ordered  so  that  the  most  tightly 
constrained  cases  are  solved  first.  Their  solutions  will  often  provide  feasible  starting  points  for 
subsequent  relaxed  problems,  as  long  the  above  precautions  are  taken. 
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Altering  Bounds  with  the  CYCLE  Option 

Sequences  of  problems  will  sometimes  be  defined  in  conjunction  with  the  CYCLE  facilities.  Various 
alterations  can  be  made  to  each  problem  from  within  your  own  subroutine  KATMOD.  In  particular, 
it  is  straightforward  to  alter  the  bounds  on  any  of  the  columns  or  slacks. 

Unfortunately,  the  present  implementation  of  MINOS  does  not  make  it  easy  to  alter  the  set 
of  supcrbasic  variables  from  within  MATMOD.  If  the  bound  on  a  nonbasic  variable  is  altered,  it  is 
simplest  to  accept  the  resulting  perturbation  to  the  values  of  the  basic  variables  (rather  than 
making  the  variable  superbasic  as  suggested  above). 


I 

I 


6.1  Iteration  Log 
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6.  OUTPUT 

The  following  information  is  output  to  the  PRINT  file  during  the  solution  of  each  problem  referred 
to  in  the  SPECS  file. 

•  A  listing  of  the  relevant  part  of  the  SPECS  file. 

•  A  listing  of  the  parameters  that  were  or  could  have  been  set  in  the  SPECS  file. 

•  An  estimate  of  the  amount  of  working  storage  needed,  compared  to  how  much  is  available. 

•  A  listing  of  the  MPS  file,  possibly  abbreviated  to  the  header  cards  and  comment  cards. 

•  Some  statistics  about  the  problem  in  the  MPS  file. 

•  The  amount  of  storage  available  for  the  LU  factorization  of  the  basis  matrix. 

•  A  summary  of  the  scaling  procedure,  if  SCALE  was  specified. 

•  Notes  about  the  initial  basis  resulting  from  a  CRASH  procedure  or  a  BASIS  file. 

•  The  iteration  log. 

•  Basis  factorization  statistics. 

•  The  EXIT  condition  and  some  statistics  about  the  solution  obtained. 

•  The  printed  solution,  if  requested. 

The  last  four  items  are  described  in  the  following  sections.  Further  brief  output  may  be 
directed  to  the  SUMMARY  file,  as  discussed  in  section  6.6. 

6.1  Iteration  Log 

One  line  of  information  is  output  to  the  PRINT  file  every  fc-th  minor  iteration,  where  k  is  the 
specified  LOG  FREQUENCY  (default  k  —  l).  A  heading  is  printed  before  the  first  such  line  following 
a  basis  factorization.  The  heading  contains  the  items  described  below.  In  this  description,  a 
PRICE  operation  is  defined  to  be  the  process  by  which  one  or  more  nonbasic  variables  are  selected 
to  become  superbasic  (in  addition  to  those  already  in  the  superbasic  set).  Normally  just  one 
variable  is  selected,  which  we  will  denote  by  JQ.  If  the  problem  is  purely  linear,  variable  JQ  will 
usually  become  basic  immediately  (unless  it  should  happen  to  reach  its  opposite  bound  and  return 
to  the  nonbasic  set). 

If  PARTIAL  PRICE  is  in  effect,  variable  JQ  is  selected  from  App  or  /pp,  the  PP-th  segments  of 
the  constraint  matrix  (A  /).  If  MULTIPLE  PRICE  is  in  effect,  several  variables  may  be  selected 
from  App  or  /pp.  In  this  case,  JQ  refers  to  the  variable  with  the  largest  favorable  reduced  cost, 
DJ. 


Label 

ITN 

PH 


Description 

The  current  iteration  number.  For  problems  with  nonlinear  constraints,  this  is  the 
cumulative  number  or  minor  iterations. 

The  current  phase  of  the  solution  procedure,  as  follows: 

1  Phase  1  of  the  simplex  method  is  being  used  to  find  a  feasible  point. 

2  Phase  2  of  the  simplex  method  is  being  used  to  optimize  the  linear  objective. 

Normally,  Phase  1  and  2  are  used  for  purely  linear  problems.  They  may  also  be 
used  at  the  start  of  a  run  even  for  nonlinear  problems,  if  the  initial  basis  contains 
only  linear  variables.  Any  superbasic  variables  will  be  temporarily  held  at  their 
initial  values. 
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3  Phase  3  of  the  reduced-gradient  procedure  is  being  used.  This  is  the  same  as  Phase 
4  except  that  a  PRICK  operation  is  performed  prior  to  the  iteration,  adding  one 
or  more  nonbasic  variables  to  the  superbasic  set. 

4  Phase  4  of  the  reduced-gradient  procedure  is  being  used.  Optimization  is  per¬ 
formed  on  the  basic  and  superbasic  variables  (ignoring  the  nonbasics). 

PP  The  Partial  Price  indicator.  The  variable(s)  selected  by  the  last  PRICE  operation 

came  from  the  PP-th  partition  of  A  and  /.  PP  is  set  to  zero  when  the  basis  is 
refactored.  It  is  reset  during  Phase  1,  2  or  3. 

NOPT  The  number  of  “non-optimal”  variables  present  in  the  set  of  nonbasic  variables 

that  were  scanned  during  the  last  PRICE  operation.  It  is  reset  during  Phase  1,  2 
or  3. 

DJ.RG  In  Phase  1,  2  or  3,  this  is  DJ,  the  reduced  cost  (or  reduced  gradient)  of  the  variable 

JQ  selected  by  PRICE  at  the  start  of  the  present  iteration.  Algebraically,  DJ  is 
dy  =  gj  —  7r Ta}  for  j  =  JQ,  where  g}  is  the  gradient  of  the  current  objective 
function,  n  is  the  vector  of  dual  variables,  and  a}  is  the  ji-th  column  of  the 
constraint  matrix  (  A  I). 

In  Phase  4,  this  quantity  is  RG,  the  norm  of  the  reduced-gradient  vector  after  the 
present  iteration.  (It  is  the  largest  value  of  |dj|  for  variables  j  in  the  superbasic 
set.) 

Note  that  for  Phase  3  iterations,  DJ  is  the  norm  of  the  reduced-gradient  vector  at 
the  start  of  the  iteration,  just  after  the  PRICE  operation. 

♦SBS  The  variable  JQ  selected  by  PRICE  to  be  added  to  the  superbasic  set.  (This  is 

zero  in  Phase  4.) 

-SBS  The  variable  chosen  to  leave  the  set  of  superbasics.  It  has  become  basic  if  the 

entry  under  -BS  is  nonzero;  otherwise  it  has  become  nonbasic. 

-BS  The  variable  removed  from  the  basis  (if  any)  to  become  nonbasic. 

STEP  The  step  length  a  taken  along  the  current  search  direction  p.  The  basic  and 

superbasic  variables  x„a  have  just  been  changed  to  z„,  +  np. 

PIVOT  If  column  a,  replaces  the  r-th  column  of  the  basis  If,  PIVOT  is  the  r-lh  element  of  a 

vector  y  satisfying  By  =  a9.  Wherever  possible.  STEP  is  chosen  to  avoid  extremely 
small  values  of  PIVOT  (since  they  cause  the  basis  to  be  nearly  singular).  In  rare 
cases,  it  may  be  necessary  to  increase  the  PIVOT  TOLERANCE  to  exclude  very  small 
elements  of  y  from  consideration  during  the  computation  of  STEP. 

L  The  number  of  nonzeros  representing  the  basis  factor  Immediately  after  a  basis 

factorization  Uf  =  U,  this  is  LENL,  the  number  of  subdiagon.il  elements  in  the 
columns  of  a  lower  triangular  matrix.  I'urlher  nonzeros  are  added  to  L  when 
various  columns  of  B  are  later  replaced.  (Thus,  L  increases  monotonioally.) 

U  The  number  of  nonzeros  in  the  basis  factor  ( ' .  Immediately  after  a  basis  factoriza¬ 

tion,  this  is  LENU,  the  number  of  diagonal  and  superdiagonal  elements  in  the  rows 
of  an  upper  triangular  matrix.  As  columns  of  If  are  replaced,  the  matrix  U  is 
maintained  explicitly  (in  sparse  form).  The  value  of  U  may  fluctuate  up  or  down; 
in  general  it  will  tend  to  increase. 
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NCP  The  number  of  compressions  required  to  recover  storage  in  the  data  structure  for 

U.  This  includes  the  number  of  compressions  needed  during  the  previous  basis 
factorization.  Normally  NCP  should  increase  very  slowly.  If  not,  the  amount  of 
workspace  available  to  MINOS  should  be  increased  by  a  significant  amount.  As  a 
suggestion,  the  work  array  Z(*>  should  be  extended  by  L  +  U  elements. 

NINF  The  number  of  infeasibilities  before  the  present  iteration.  This  number  decreases 

monotonically. 

SINF ,  OBJECTIVE  If  NINF  >  0,  this  is  SINF,  the  sum  of  infeasibilitics  before  the  present  iteration. 

(It  will  usually  decrease  at  each  nonzero  STEP,  but  if  NINF  decreases  by  2  or  more, 
SINF  may  occasionally  increase.) 

Otherwise,  it  is  the  value  of  the  current  objective  function  after  the  present 
iteration.  Note  that  “current  objective  function”  can  mean  different  things  when 
NINF  =  0.  For  linear  programs,  it  means  the  true  linear  objective  function.  For 
problems  with  linear  constraints,  it  means  the  sum  of  the  linear  objective  and  the 
value  returned  by  subroutine  FUNOBJ.  For  problems  with  nonlinear  constraints,  it 
is  the  quantity  just  described  if  LAGRANGIAN  =  NO;  otherwise  it  is  the  value  of  the 
augmented  Lag  ran  gi  an  function  for  the  current  major  iteration  (which  tends  to 
the  true  objective  function  as  convergence  is  approached). 


The  following  items  arc  printed  if  the  problem  is  nonlinear  or  if  the  superbasic  set  is  non-empty 

(i.e.,  if  the  current  solution  is  nonbasic). 

Label  Description 

NOON  The  number  of  times  subroutine  FUNCON  lias  been  called  to  evaluate  the  nonlinear 

constraint  functions. 

NOBJ  The  number  of  times  subroutine  FUNOBJ  has  been  called  to  evaluate  the  nonlinear 

objective  function. 

NSB  The  current  number  of  superbasic  variables. 

HMOD  An  indication  of  the  type  of  modifications  made  to  the  triangular  matrix  It  that 

is  used  to  approximate  the  reduced  Hessian  matrix.  Two  integers  i|  and  ij  are 
shown.  They  will  remain  zero  Tor  linear  problems.  IT t ■  =  l,  a  MFCS  quasi-Newton 
update  has  been  made  to  R,  to  account  for  a  move  within  the  current  subspacc. 
(This  will  not  occur  if  the  solution  is  infeasible.)  If  ij  =  1,  R  has  been  modified 
to  account  for  a  change  in  basis.  This  will  sometimes  occur  even  if  the  solution  is 
infeasible  (if  a  feasible  point  was  obtained  at  some  earlier  stage). 


Both  updates  arc  implemented  by  triangularizing  the  matrix  R  +  vwT  for  some 
vectors  v  and  w.  If  an  update  fails  for  numerical  reasons,  t  (  or  ij  will  be  set  to  2, 
and  the  resulting  R  will  be  nearly  singular.  (However,  this  is  highly  unlikely.) 
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H-CONDN 


COMV 


1 


An  estimate  of  the  condition  number  of  the  reduced  Hessian.  It  is  the  square  of 
the  ratio  of  the  largest  and  smallest  diagonals  of  the  upper  triangular  matrix  R. 
This  constitutes  a  lower  bound  on  the  condition  number  of  the  matrix  RT R  that 
approximates  the  reduced  Hessian.  H-CONDN  gives  a  rough  indication  of  whether  or 
not  the  optimization  procedure  is  having  difficulty.  If  f  is  the  relative  precision  of 
the  machine  being  used,  the  reduced-gradient  algorithm  will  make  slow  progress  if 
H-CONDN  becomes  as  large  as  c"1/2,  and  will  probably  fail  to  find  a  better  solution 
if  H-CONDN  reaches  c-3/4  or  larger.  (On  I13M-like  machines,  these  values  are  about 
108  and  1012.) 

To  guard  against  high  values  of  H-CONDN,  attention  should  be  given  to  the  scaling 
of  the  variables  and  the  constraints.  In  some  cases  it  may  be  necessary  to  add 
upper  or  lower  bounds  to  certain  variables  to  keep  them  a  reasonable  distance 
from  singularities  in  the  nonlinear  functions  or  their  derivatives. 

A  set  of  four  logical  variables  C\,  C2,  C3,  C4  that  are  used  to  determine  when  to 
discontinue  optimization  in  the  current  subspace  (Phase  4)  and  consider  releasing  a 
nonbasic  variable  from  its  bound  (the  PRICE  operation  of  Phase  3).  Let  RG  be  the 
norm  of  the  reduced  gradient,  as  described  above.  The  meaning  of  the  variables 
Cj  is  as  follows: 

Ci  is  TRUE  if  the  change  in  x  was  sufficiently  small; 

C2  is  TRUE  if  the  change  in  the  objective  was  sufficiently  small; 

C3  is  TRUE  if  RG  is  smaller  than  some  loose  tolerance  TOLRG; 

C4  is  TRUE  if  RG  is  smaller  than  some  tighter  tolerance. 

The  test  used  is  of  the  form 

if  (Ci  and  C2  and  C 3)  or  C4  then  go  to  Phase  3. 

In  the  present  implementation,  TOLRG  =  <|DJ|,  where  t  is  the  SUBSPACE  TOLERANCE 
(nominally  0.5)  and  DJ  is  the  reduced-gradient  norm  at  the  most  recent  Phase  3 
iteration.  The  “tighter  tolerance”  is  the  maximum  of  0.1  TOLRG  and  10-7||x||. 
Only  the  tolerance  t  can  be  altered  at  run-time  (see  section  3.3). 


6.2  llasis  Factorization  Statistics 
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6.2  Basis  Factorization  Statistics 

The  following  items  arc  output  whenever  the  basis  matrix  B  is  factored.  Gaussian  elimination  is 
used  to  compute  an  LU  factorization  of  the  form 

LB  =  U, 


where  L  is  unit  lower  triangular  and  Pf!Q  is  upper  triangular  for  some  permutation  matrices  P 
and  Q.  This  factorization  is  stabilized  in  the  manner  described  under  LU  FACTOR  TOLERANCE  in 
section  3.3. 


Label 

FACTORIZE 

DEMAND 

ITERATION 

INFEAS 

OBJECTIVE 


NONLINEAR 

LINEAR 

SLACKS 

ELEMS 

DENSITY 

COMPRSSNS 


MERIT 


LENL 


Description 

The  number  of  factorizations  since  the  start  of  the  run. 

A  code  giving  the  reason  for  the  present  factorization.  (Since  this  is  not  important 
to  the  user  we  omit  details.) 

The  current  iteration  number. 

The  number  of  infeasibilities  at  the  start  of  the  previous  iteration. 

If  INFEAS  >  0,  this  is  the  sum  of  infeasibilitics  at  the  start  of  the  previous  iteration. 

If  INFEAS  =  0,  this  is  the  value  of  the  objective  function  after  the  previous 
iteration.  If  there  are  nonlinear  constraints,  it  is  the  value  of  the  augmented 
Lagrangian  for  the  present  subproblem. 

The  number  of  nonlinear  variables  in  the  current  basis  B. 

The  number  of  linear  variables  in  B. 

The  number  of  slack  variables  in  B. 

The  number  of  nonzero  matrix  elements  in  B. 

The  percentage  nonzero  density  of  />,  100  X  ELEMS/(M  X  M),  where  M  is  the  number 
of  rows  in  the  problem  (M  =  NONLINEAR  +  LINEAR  f  SLACKS). 

The  number  of  times  the  data  structure  holding  the  partially  factored  matrix 
needed  to  be  compressed,  to  recover  unused  storage.  Ideally  this  number  should 
be  zero.  If  it  is  more  than  3  or  1,  the  amount  of  workspace  available  to  MINOS 
should  be  increased  for  ciriciency. 

The  average  Markowitz  merit  count  for  the  elements  chosen  to  bo  the  diagonals 
of  PUQ.  Each  merit  count  is  defined  to  be  (c  —  I ){ r  —  I)  where  c  and  r  are  the 
number  of  nonzeros  in  the  column  and  row  containing  the  element  at  the  time  it 
is  selected  to  be  the  next  diagonal.  MERIT  is  the  average  of  M  such  quantities.  It 
gives  an  indication  of  how  much  work  was  required  to  preserve  sparsity  during  the 
factorization. 

The  number  of  nonzeros  in  On  IMM-hke  machines,  each  nonzero  is  represented 
by  one  REAL*8  and  two  INTEGER*2  data  types. 


LENU 


The  number  of  nonzeros  in  (I.  The  storage  required  for  each  nonzero  is  the  same 
as  for  the  non  zeros  of  /,. 
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INCREASE 

LMAX 

BMAX 

UMAX 


UMIN 

GROWTH 
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The  percentage  increase  in  the  number  of  nonzeros  in  L  and  U  relative  to  the 
number  of  nonzeros  in  B;  i.e.,  100  X  (LENL  +  LENU  -  ELEMS)/ELEMS. 

The  maximum  subdiagonal  clement  in  the  columns  of  L.  This  will  be  no  larger 
than  the  LU  FACTOR  TOLERANCE. 

The  maximum  nonzero  element  in  B. 

The  maximum  nonzero  element  in  (J,  excluding  elements  of  B  that  remain  in  U 
unaltered.  (For  example,  if  a  stack  variable  is  in  the  basis,  the  corresponding  row 
of  B  will  become  a  row  of  U  without  alteration.  Elements  in  such  rows  will  not 
contribute  to  UMAX.  If  the  basis  is  strictly  triangular,  none  of  the  elements  of  B 
will  contribute,  and  UMAX  will  be  zero.) 

Ideally,  UMAX  should  not  be  substantially  larger  than  BMAX.  If  it  is  several  orders 
of  magnitude  larger,  it  may  be  advisable  to  reduce  the  LU  FACTOR  TOLERANCE  to 
some  value  nearer  1.0.  (The  default  value  is  10.0.) 

The  smallest  diagonal  element  of  PUQ  in  absolute  magnitude. 

The  ratio  UMAX/BMAX,  which  should  not  be  too  large  (see  above). 

As  long  as  LMAX  is  not  large  (say  10.0  or  less),  the  ratio  max{BMAX,  UMAX} /UMIN 
gives  an  estimate  of  the  condition  number  of  B.  If  this  number  is  extremely  large, 
the  basis  is  nearly  singular  and  some  numerical  difficulties  could  conceivably  occur. 
(However,  an  effort  is  made  to  avoid  near-singularity  by  using  slacks  to  replace 
columns  of  B  that  would  have  made  UMIN  extremely  small.  Messages  are  issued  l.o 
this  effect,  and  the  modified  basis  is  refactored.) 


6.3  EXIT  Conditions 
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6.3  EXIT  Condition! 

For  each  problem  in  the  SPECS  file,  a  message  of  the  'arm  EXIT  —  message  is  printed  to 
summarize  the  final  result.  Here  we  describe  each  message  and  suggest  possible  courses  of  action. 

System  Note:  A  number  is  associated  with  each  message  below.  It  is  the  final  value  assigned 
to  the  integer  variables  INFORM  and  IERR,  for  possible  use  within  subroutines  MIN0S1  and  MIN0S2. 
The  variables  appear  in  the  declarations 


and 


SUBROUTINE  MIN0S2(  Z , NWCORE, NCALLS, INFORM  ) 
COMMON  /M5LQG1/  IDEBUG , IERR , LPRINT 


If  a  problem  is  infeasible,  for  example,  their  final  values  will  be  INFORM  =  IERR  =  1. 


The  following  messages  arise  when  the  SPECS  file  is  found  to  contain 
no  further  problems. 


-2.  EXIT  —  INPUT  ERROR.  MINOS  ENCOUNTERED  END-OF-FILE  OR  AN 
ENDRUN  CARD  BEFORE  FINDING  A  SPECS  FILE  ON  UNIT  nn 
The  SPECS  file  may  not  be  properly  assigned.  Its  unit  number  nn  is  defined  at  compile  time  in 
subroutine  MIFILE,  and  normally  it  is  the  system  card  input  stream. 

Otherwise,  the  SPECS  file  may  be  empty,  or  cards  containing  the  keywords  SKIP  or  ENDRUN 
may  imply  that  all  problems  should  be  ignored  (see  section  1.8). 


-1.  ENDRUN 

This  message  is  printed  at  the  end  of  a  run  if  MINOS  terminates  of  its  own  accord.  Otherwise, 
the  operating  system  will  have  intervened  for  one  of  many  possible  reasons  (excess  time,  missing 
file,  arithmetic  error  in  user  routines,  etc.). 


The  following  messages  arise  when  optimization  terminates  grace¬ 
fully.  A  solution  exists,  any  of  the  BASIS  files  may  be  saved,  and 
the  solution  will  be  printed  and/or  saved  on  the  SOU'TION  file  if 
requested. 


0.  EXIT  —  OPTIMAL  SOLUTION  FOUND 

This  is  the  message  we  all  hope  to  sec!  It  is  certainly  preferable  to  every  other  message, 
and  we  naturally  want  to  believe  what  it  says,  because  this  is  surely  one  situation  where  the 
computer  knows  best.  There  may  be  cause  for  celebration  if  the  objective  function  has  reached 
an  astonishingly  new  high  (or  low).  Or  perhaps  it  will  signal  the  end  of  a  strenuous  series  of  runs 
that  have  iterated  far  into  the  night,  depleting  one’s  patience  and  computing  funds  to  an  equally 
alarming  degree.  (We  hope  not!) 

In  all  cases,  a  distinct  level  of  caution  is  in  order,  even  if  it  can  wait  until  next  morning.  For 
example,  if  the  objective  value  is  much  better  than  expected,  we  may  have  obtained  an  optimal 
solution  to  the  wrong  problem!  Almost  any  item  of  data  could  have  that  effect,  if  it  has  the  wrong 
value  or  is  entered  in  the  wrong  columns  of  an  input  record.  There  may  be  thousands  of  items  of 
data  in  the  MI’S  file,  and  the  nonlinear  functions  (if  any)  could  depend  on  input  files  and  other 
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data  in  innumerable  ways.  Verifying  that  the  problem  has  been  defined  correctly  is  one  of  the 
more  difficult  tasks  for  a  model  builder.  For  early  runs,  we  suggest  that  the  LIST  LIMIT  be  set 
to  a  suitably  large  number  to  allow  the  MI'S  file  to  be  printed  for  visual  checking.  It  is  also  good 
practice  in  the  function  subroutines  to  print  any  data  that  is  read  in  on  the  first  entry. 

If  nonlincarities  exist,  one  must  always  ask  the  question:  could  there  be  more  than  one  local 
optimum?  When  the  constraints  are  linear  and  the  objective  is  known  to  be  convex  (e.g.,  a  sum 
of  squares)  then  all  will  be  well  if  we  are  minimizing  the  objective:  a  local  minimum  is  a  global 
minimum  in  the  sense  that  no  other  point  has  a  lower  function  value.  (However,  many  points 
could  have  the  same  objective  value,  particularly  if  the  objective  is  largely  linear.)  Conversely,  if 
we  are  maximizing  a  convex  function,  a  local  maximum  cannot  be  expected  to  be  global,  unless 
there  are  sufficient  constraints  to  confine  the  feasible  region. 

Similar  statements  could  be  made  about  nonlinear  constraints  defining  convex  or  concave 
regions.  However,  the  functions  of  a  problem  arc  more  likely  to  be  neither  convex  nor  concave. 
Our  advice  is  always  to  specify  a  starting  point  that  is  as  good  an  estimate  as  possible,  and  to 
include  reasonable  upper  and  lower  bounds  on  all  variables,  in  order  to  confine  the  solution  to 
the  specific  region  of  interest.  We  expect  modellers  to  know  something  about  their  problem,  and 
to  make  use  of  that  knowledge  as  they  themselves  know  best. 

One  other  caution  about  “OPTIMAL  S0LUTI0N”s.  When  nonlincarities  are  present,  the  final 
size  of  the  reduced-gradient  norm  (NORM  RG)  should  be  examined  to  see  if  it  is  reasonably  small 
compared  to  the  norm  of  the  dual  variables  (NORM  Pi).  These  quantities  are  printed  following  the 
EXIT  message.  MINOS  attempts  to  ensure  that 

NORM  RG  /  NORM  PI  <  OPTIMALITY  TOLERANCE. 

However,  if  messages  of  the  form  XXX  SEARCH  TERMINATED  occur  at  the  end  of  the  run,  this 
condition  will  probably  not  have  been  satisfied.  The  final  solution  may  or  may  not  be  acceptably 
close  to  optimal.  Broadly  speaking,  if 

NORM  RG  /  NORM  PI  =  10"*, 

then  the  objective  function  would  probably  change  in  the  d-t.h  significant  digit  if  optimization 
could  be  continued.  One  must  judge  whether  or  not  d  is  sufficiently  large. 

1.  EXIT  —  THE  PROBLEM  IS  INFEASIBLE 

When  the  constraints  are  linear,  this  message  can  probably  be  trusted.  Feasibility  is  measured 
with  respect  to  the  upper  and  lower  bounds  on  the  variables.  The  message  tells  us  that  among 
all  the  points  satisfying  the  general  constraints  Ax  +  s  =  0,  there  is  apparently  no  point  that 
satisfies  the  bounds  on  z  and  s.  Violations  as  small  as  the  FEASIBILITY  TOLERANCE  arc  ignored, 
but  at  least  one  component  of  z  or  <  violates  a  bound  by  more  than  the  tolerance. 

Note:  Although  the  objective  function  is  the  sum  or  infeasibilities  (when  NINF  >  0),  this  sum 
will  usually  not  have  been  minimized  when  MINOS  recognizes  the  situation  and  exits.  There  may 
exist  other  points  that  have  a  significantly  lower  sum  of  infeasibilities. 

When  nonlinear  constraints  are  present,  infeasibility  is  much  harder  to  recognize  correctly. 
Even  if  a  feasible  solution  exists,  the  current  linearization  of  the  constraints  may  not  contain  a 
feasible  point.  In  an  attempt  to  deal  with  this  situation,  MINOS  is  prepared  to  relax  the  bounds 
on  the  slacks  associated  with  nonlinear  rows.  In  the  current  implementation,  the  bounds  are 
relaxed  by  increasingly  large  amounts  up  to  5  times  per  major  iteration.  Normally  a  feasible  point 
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will  be  obtained  to  the  perturbed  constraints,  and  optimisation  can  continue  on  the  subproblem. 
However,  if  5  consecutive  subproblcms  require  such  perturbation,  the  problem  is  terminated 
and  declared  INFEASIBLE.  Clearly  this  is  an  ad  hoc  procedure.  Wherever  possible,  nonlinear 
constraints  should  be  defined  in  such  a  way  that  feasible  points  are  known  to  exist  when  the 
constraints  are  linearized. 

2.  EXIT  —  THE  PROBLEM  IS  UNBOUNDED  (OR  BADLY  SCALED) 

For  linear  problems,  unboundedness  is  detected  by  the  simplex  method  when  a  nonbasic  variable 
can  apparently  be  increased  or  decreased  by  an  arbitrary  amount  without  causing  a  basic  variable 
to  violate  a  bound.  A  message  prior  to  the  EXIT  message  will  give  the  index  of  the  nonbasic 
variable.  Consider  adding  an  upper  or  lower  bound  to  the  variable.  Also,  examine  the  constraints 
that  have  nonzeros  in  the  associated  column,  to  sec  if  they  have  been  formulated  as  intended. 

Very  rarely,  the  scaling  of  the  problem  could  be  so  poor  that  numerical  error  will  give  an 
erroneous  indication  of  unboundedness.  Consider  using  the  SCALE  option. 

For  nonlinear  problems,  MINOS  monitors  both  the  size  of  the  current  objective  function  and 
the  size  of  the  change  in  the  variables  at  each  step.  If  either  of  these  is  very  large  (as  judged  by 
the  UNBOUNDED  parameters  -  sec  section  3.3),  the  problem  is  terminated  and  declared  UNBOUNDED. 
To  avoid  large  function  values,  it  may  be  necessary  to  impose  bounds  on  some  of  the  variables  in 
order  to  keep  them  away  from  singularities  in  the  nonlinear  functions. 


3.  EXIT  —  TOO  MANY  ITERATIONS 

Either  the  ITERATIONS  LIMIT  or  the  MAJOR  ITERATIONS  LIMIT  was  exceeded  before  the  required 
solution  could  be  found.  Check  the  iteration  log  to  be  sure  that  progress  was  being  made.  If  so, 
restart  the  run  using  a  basis  file  that  was  saved  (or  should  have  been  saved!)  at  the  end  of  the 
run. 


4.  EXIT  —  THE  OBJECTIVE  HAS  NOT  CHANGED  FOR  THE  LAST  nnn  ITERATIONS 

This  is  an  emergency  measure  for  the  rare  occasions  when  the  solution  procedure  appears  to  be 
cycling.  Suppose  that  a  zero  step  is  taken  for  several  consecutive  iterations,  with  a  basis  change 
occurring  each  time.  It  is  theoretically  possible  for  the  set  of  basic  variables  to  become  the  same 
as  they  were  one  or  more  iterations  earlier.  The  same  sequence  of  iterations  would  then  occur  ad 
infinitum. 

No  direct  attempt  is  made  to  recognize  such  cycling.  The  method  used  for  determining 
the  step  size  tends  to  guard  against  it  happening,  but  nothing  is  guaranteed.  Furthermore,  on 
so-called  degenerate  models  (in  which  many  basic  variables  are  equal  in  value  to  their  upper  or 
lower  bounds),  a  great  number  of  consecutive  zero  steps  may  have  to  occur  before  any  progress 
can  be  made.  A  generous  limit  is  therefore  used  on  the  number  of  consecutive  zero  steps  allowed 
before  this  exit  is  taken.  For  small  problems,  the  limit  nnn  is  the  maximum  or  200  and  2(m  +  n). 
For  large  problems  (m  +  n  >  1000)  it  is  1000. 

5.  EXIT  --  THE  SUPERBASICS  LIMIT  IS  TOO  SMALL...  nnn 

The  problem  appears  to  be  more  nonlinear  than  anticipated.  The  current  set  of  basic  and 
superbasic  variables  have  been  optimized  as  much  as  possible  and  a  PRICE  operation  is  necessary 
to  continue,  but  there  arc  already  nnn  superbasics  (and  no  room  for  any  more). 

In  general,  raise  the  SUPERBASICS  LIMIT  s  by  a  reasonable  amount,  bearing  in  mind  the 
storage  needed  for  the  reduced  Hessian.  (The  HESSIAN  DIMENSION  h  will  also  increase  to  s 
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unless  specified  otherwise,  and  the  associated  storage  will  he  about  1/2 a*  words.)  In  extreme 
cases  you  may  have  to  set  h  <  *  to  conserve  storage,  but  beware  that  the  rate  of  convergence 
will  probably  fall  off  severely. 

6.  EXIT  —  REQUESTED  BY  USER  IN  SUBROUTINE  FUNOBJ  (or  FUNCON) 

AFTER  mm  CALLS 

This  exit  occurs  if  the  subroutine  parameter  MODE  is  set  to  a  negative  number  during  some  call 
to  FUNOBJ  or  FUNCON.  MINOS  assumes  that  you  want  the  problem  to  be  abandoned  forthwith. 

In  some  environments,  this  exit  means  that  your  subroutines  were  not  successfully  linked 
to  MINOS.  If  the  default  versions  of  FUNOBJ  and  FUNCON  are  ever  called,  they  issue  a  warning 
message  and  then  set  MODE  to  terminate  the  run.  For  example,  you  may  have  asked  the  operating 
system  to 

LINK  MINOS.  FUNOBJ.  FUNCON 
when  in  fact  you  should  have  said 

LINK  FUNOBJ.  FUNCON.  MINOS 

(or  something  similar)  to  give  your  own  subroutines  priority.  Most  linkers  or  loaders  retain  the 
first  version  of  any  subprogram  that  they  see. 


7.  EXIT  —  SUBROUTINE  FUNOBJ  SEEMS  TO  BE  GIVING  INCORRECT  GRADIENTS 
A  check  has  been  made  on  some  individual  elements  of  the  gradient  array,  and  at  least  one 
component  G (j)  is  being  set  to  a  value  that  disagrees  markedly  with  a  forward-difference  estimate 
of  dF/dij.  (The  relative  difference  between  the  computed  and  estimated  values  is  1.0  or  more.) 
This  exit  is  a  safeguard,  since  MINOS  will  usually  fail  to  make  progress  when  the  computed 
gradients  are  seriously  inaccurate.  In  the  process  it  may  expend  considerable  effort  before 
terminating  with  exit  9  below. 

Check  the  function  and  gradient  computation  very  carefully.  A  simple  omission  (such  as 
forgetting  to  divide  F  by  2)  could  explain  everything.  If  F  or  G(j)  is  very  large,  then  give  serious 
thought  to  scaling  the  function  or  the  nonlinear  variables. 

If  you  feel  certain  that  the  computed  G(j)  is  correct  (and  that  the  rorward-dilTcrcncc  estimate 
is  therefore  wrong),  you  can  specify  VERIFY  LEVEL  0  to  prrvent  individual  elements  from  being 
checked.  However,  the  optimization  procedure  is  likely  to  terminate  unsuccessfully. 


8.  EXIT  --  SUBROUTINE  FUNCON  SEEMS  TO  BE  GIVING  INCORRECT  GRADIENTS 
This  is  analogous  to  the  preceding  exit.  At  least  one  or  the  computed  Jacobian  elements  is 
significantly  different  from  an  estimate  obtained  by  forward-differencing  the  constraint  vector 
/(x).  Follow  the  advice  given  above,  trying  to  ensure  that  the  arrays  F  and  G  arc  being  set 
correctly  in  subroutine  FUNCON. 


9.  EXIT  —  THE  CURRENT  POINT  CANNOT  BE  IMPROVED  UPON 
Several  circumstances  could  lead  to  this  exit. 

1.  Subroutine  FUNOBJ  and/or  subroutine  FUNCON  could  be  returning  accurate  function  values 
but  inaccurate  gradients  (or  vice  versa).  This  is  the  most  likely  cause.  Study  the  comments 
given  for  exits  7  and  8,  and  do  your  utmost  to  ensure  that  the  subroutines  are  coded  correctly. 
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2.  The  function  and  gradient  values  could  be  consistent,  but  their  precision  could  be  too  low.  For 
example,  accidental  use  of  a  single- precision  data  type  when  double- precision  was  intended 
throughout,  would  lead  to  a  relative  function  precision  of  about  10-6  instead  of  something 
like  lO-15.  The  default  OPTIMALITY  TOLERANCE  or  10-8  would  need  to  be  raised  to  about 
10~3  for  optimality  to  be  declared  (at  a  rather  suboptimal  point).  Of  course,  it  is  better  to 
revise  the  function  coding  to  obtain  as  much  precision  as  economically  possible. 

3.  If  function  values  arc  obtained  from  an  expensive  iterative  process,  they  may  be  accurate 
to  rather  few  significant  figures,  and  gradients  will  probably  not  be  available.  One  should 
specify 

FUNCTION  PRECISION  t 

OPTIMALITY  TOLERANCE  \ft 

but  even  then,  if  t  is  as  large  as  10-5  or  10“*  (only  5  or  6  significant  figures),  the  same  exit 
condition  may  occur.  At  present  the  only  remedy  is  to  increase  the  accuracy  of  the  function 
calculation. 

10.  EXIT  —  NUMERICAL  ERROR.  GENERAL  CONSTRAINTS  CANNOT  BE  SATISFIED  ACCURATELY 
An  LU  factorization  of  the  basis  has  just  been  obtained  and  used  to  recompute  the  basic  variables 
xg,  given  the  present  values  of  the  superbasic  and  nonbasic  variables.  A  single  step  of  “iterative 
refinement”  has  also  been  applied  to  increase  the  accuracy  of  Xg.  However,  a  row  check  has 
revealed  that  the  resulting  solution  does  not  satisfy  the  current  constraints  Ax+  e  —  0  sufficiently 
well. 

This  probably  means  that  the  current  basis  is  very  ill-conditioned.  Request  the  SCALE  option 
if  there  are  any  linear  constraints  and  variables. 

For  certain  highly  structured  basis  matrices  (notably  those  with  band  structure),  a  systematic 
growth  may  occur  in  the  factor  U .  Consult  the  description  of  UMAX,  UMIN  and  GROWTH  in  section 
6.2,  and  set  the  LU  FACTOR  TOLERANCE  to  2.0  (or  possibly  even  smaller,  but  not  less  than  1.0). 

11.  EXIT  —  CANNOT  FIND  SUPERBASIC  TO  REPLACE  BASIC  VARIABLE 

If  this  exit  occurs,  the  problem  must  be  very  badly  scaled.  A  basic  variable  has  reached  a  bound 
and  must  be  replaced,  but  none  of  the  superbasic  columns  has  a  pivot  element  exceeding  the 
PIVOT  TOLERANCE.  The  latter  could  be  reduced  (at  great  risk).  You  should  first  try  specifying 
SCALE. 

12.  EXIT  —  BASIS  FACTORIZATION  REQUESTED  TWICE  IN  A  ROW 

This  exit  may  occur  after  the  linoscarch  has  terminated  unsuccessfully  several  times  in  a  row.  It 
is  a  safeguard  to  prevent  the  various  recovery  measures  Trom  being  repealed  endlessly.  It  should 
probably  be  treated  as  if  it  were  exit  9. 
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If  the  following  exits  occur  during  the  first  basis  factorization,  the 
basic  variables  x b  will  have  certain  default  values  that  may  not  be 
particularly  meaningful,  and  the  dual  vector  ir  will  be  zero.  BASIS 
files  will  be  saved  if  requested,  but  certain  values  in  the  printed 
solution  will  not  be  meaningful.  The  problem  will  be  terminated, 
even  if  the  CYCLE  LIMIT  has  not  yet  been  reached. 


20.  EXIT  —  NOT  ENOUGH  STORAGE  FOR  THE  BASIS  FACTORIZATION 

The  main  storage  array  Z(*)  is  apparently  not  large  enough  for  this  problem.  The  routine 
declaring  Z  is  probably  the  main  program.  It  should  be  recompiled  with  a  larger  dimension  for 
Z.  The  new  value  should  also  be  assigned  to  NWCORE. 

In  some  cases  it  may  be  sufficient  to  increase  the  specified  WORKSPACE  (USER) ,  if  it  is  currently 
less  than  WORKSPACE  (TOTAL) . 

An  estimate  of  the  additional  storage  required  is  given  in  messages  preceding  the  exit. 


21.  EXIT  —  ERROR  IN  BASIS  PACKAGE 

A  preceding  message  will  describe  the  error  in  more  detail.  One  such  message  says  that  the  current 
basis  has  more  than  one  element  in  row  i  and  column  j.  This  could  be  caused  by  a  corresponding 
error  in  the  MPS  file.  (MINOS  does  not  check  for  duplicate  row  names  within  each  column.) 
Determine  the  name  of  row  i  (c.g.,  by  consulting  the  i-th  entry  in  the  rows  section  of  the  printed 
solution),  and  scan  the  COLUMNS  section  of  the  MPS  file  for  that  name.  Alternatively,  check 
the  (j  —  l)-t h  variable  in  the  COLUMNS  section  of  the  MPS  file,  where  1  is  the  number  of  slack 
variables  in  the  basis. 


22.  EXIT  —  THE  BASIS  IS  STRUCTURALLY  SINGULAR  AFTER  TWO  FACTORIZATION  ATTEMPTS 
This  exit  is  highly  unlikely  to  occur.  The  first  factorization  attempt  will  have  found  Lhc  basis 
to  be  structurally  or  numerically  singular.  (Some  diagonals  of  the  triangular  matrix  PUQ  were 
respectively  zero  or  smaller  than  a  certain  tolerance.)  The  associated  variables  are  replaced  by 
slacks  and  the  modified  basis  is  rcfactorizcd.  The  ensuing  singularity  must  mean  that  the  problem 
is  badly  scaled,  or  the  LU  FACTOR  TOLERANCE  is  too  high. 


If  the  following  messages  arise,  the  MPS  tile  was  read  successfully. 
However,  either  an  OLD  BASIS  file  could  not  be  loaded  properly,  or 
some  fatal  system  error  has  occurred.  New  BASIS  files  cannot  be 
saved,  and  there  is  no  solution  to  print.  The  problem  is  abandoned. 


30.  EXIT  —  THE  BASIS  FILE  DIMENSIONS  DO  NOT  MATCH  THIS  PROBLEM 
On  the  first  card  of  the  OLD  BASIS  file,  the  dimensions  labelled  M  and  N  are  different  from  those 
associated  with  the  MPS  file  that  has  just  been  read.  You  have  probably  loaded  a  file  that  belongs 
to  some  other  problem. 

Remember,  if  you  have  added  rows  or  columns  to  the  MPS  file,  you  will  have  to  alter  M  and 
N  and  the  map  beginning  on  the  third  card  (a  hazardous  operation).  It  may  be  easier  to  restart 
with  a  PUNCH  or  DUMP  file  from  the  earlier  version  of  the  problem. 


6.3  EXIT  Conditions 
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31.  EXIT  —  THE  BASIS  FILE  STATE  VECTOR  DOES  NOT  MATCH  THIS  PROBLEM 
For  some  reason,  the  OLD  BASIS  file  is  incompatible  with  the  present  problem,  or  is  not  consistent 
within  itself.  The  number  of  basic  entries  in  the  state  vector  (i.c.,  the  number  of  3’s  in  the  map)  is 
not  the  same  as  M  on  the  first  card,  or  else  some  of  the  2’s  in  the  map  did  not  have  a  corresponding 
j  x j  entry  following  the  map. 


32.  EXIT  —  SYSTEM  ERROR.  WRONG  NO.  OF  BASIC  VARIABLES...  turn 

This  exit  should  never  happen.  If  it  docs,  something  is  seriously  awry  in  the  MINOS  source  code. 

Perhaps  the  single-  and  double- precision  files  have  been  mixed  up. 


The  following  messages  arise  if  the  MPS  file  is  seriously  deficient,  or 
if  additional  storage  is  needed  to  allow  the  MPS  file  to  be  input  or  to 
allow  optimization  to  begin.  The  problem  is  abandoned. 


40.  EXIT  —  FATAL  ERRORS  IN  THE  MPS  FILE 
One  of  the  following  conditions  exists: 

1.  There  are  no  entries  in  the  ROWS  section. 

2.  There  are  no  entries  in  the  COLUMNS  section. 

3.  A  type  N  row  has  been  selected  to  be  the  linear  objective  row,  but  it  is  one  of  the  first  mj 
rows,  where  m,  is  the  number  of  NONLINEAR  CONSTRAINTS. 

The  first  two  conditions  speak  for  themselves.  If  condition  3  occurs,  the  N  row  may  be  have  been 
selected  by  default  (if  you  did  not  specify  any  OBJECTIVE  name  in  the  SPECS  file).  To  prevent 
this,  specify  some  other  (possibly  fictitious)  row  name.  Otherwise,  you  must  put  the  N  row  after 
the  nonlinear  row  names  in  the  ROWS  section. 

41.  EXIT  —  NOT  ENOUGH  STORAGE  TO  READ  THE  MPS  FILE 

One  of  the  ROWS,  COLUMNS,  or  ELEMENTS  estimates  in  the  SPECS  file  proved  to  be  too  small.  The 
minimum  (exact)  values  are  shown  in  earlier  messages.  You  must  specify  these  values,  or  higher 
values,  and  re-run  the  problem. 

If  the  MPS  data  had  been  on  a  file  of  its  own  (rather  than  in  the  card  input  stream),  MINOS 
would  have  been  able  to  continue  by  rewinding  the  MPS  file  and  trying  again. 


42.  EXIT  —  HOT  ENOUGH  STORAGE  TO  START  SOLVING  THE  PROBLEM 

The  MPS  file  was  read  succcsfully,  but  the  main  storage  array  Z(*)  is  not  large  enough  to  provide 
workspace  for  the  optimization  procedure.  Be  sure  that  the  SUPERBASICS  LIMIT  and  HESSIAN 
DIMENSION  are  not  unreasonably  large.  Otherwise,  sec  the  advice  given  for  exit  20. 
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6.  Output 


6.4  Solution  Output 

At  the  end  of  a  run,  the  final  solution  will  be  output  to  the  PRINT  file  in  accordance  with  the 
SOLUTION  keyword.  Some  header  information  appears  first  to  identify  the  problem  and  the  final 
state  of  the  optimization  procedure.  A  ROWS  section  and  a  COLUMNS  section  then  follow, 
giving  one  line  of  information  for  each  row  and  column.  The  format  used  is  similar  to  that  seen 
in  commercial  systems,  though  there  is  no  rigid  industry  standard. 

ROWS  Section 

The  general  constraints  take  the  form  /  <  f[x)  +  Ay  <  u,  where  z  and  y  are  the  nonlinear  and 
linear  variables  respectively.  The  »-th  constraint  is  therefore  of  the  form 

a  <  /’(*)  +  aTy  <  P, 

and  we  define  the  i-th  “row”  to  be  the  linearization  of  f'(x)  +  aTy.  For  linear  constraints,  the 
i-th  row  is  just  aTy. 

Internally,  the  constraints  take  the  form  Lf{x)  +  Ay  +  a  =0  where  Lf(x)  is  the  current 
linearization  of  /(z),  and  s  is  the  set  of  slack  variables  (which  happen  to  satisfy  the  bounds 
— u  <  8  <  — /).  For  the  i-th  constraint  it  is  the  slack  variable  s,  that  is  directly  available,  and  it 
is  sometimes  convenient  to  refer  to  its  state. 

Label  Description 

NUMBER  The  value  n  +  i.  This  is  the  internal  number  used  to  refer  to  the  i-th  slack  in  the 

iteration  log. 

ROW  The  name  of  the  i-th  row. 

STATE  The  state  of  the  i-th  row  relative  to  the  bounds  a  and  fl.  The  various  states 

possible  arc  as  follows. 

LL  The  row  is  at  its  lower  limit,  a. 

UL  The  row  is  at  its  upper  iimit,  /?. 

EQ  The  row  is  equal  to  the  RHS  element,  a  =  0. 

BS  The  constraint  is  not  binding,  a,  is  basic. 

SBS  The  constraint  is  not  binding.  8,  is  supcrbasic. 

A  key  is  sometimes  printed  before  the  STATE  to  give  some  additional  information 
about  the  state  of  the  slack  variable. 

A  Alternative  optimum  possible.  The  slack  is  nonbasic,  but  its  reduced  gradient  is 

essentially  zero.  This  means  that  if  the  slack  were  allowed  to  start  moving  away 
from  its  bound,  there  would  be  no  change  in  the  value  of  the  objective  function. 
The  values  of  the  basic  and  supcrbasic  variables  might  change,  giving  a  genuine 
alternative  solution.  However,  if  there  arc  any  degenerate  variables  (labelled  D), 
the  actual  change  might  prove  to.  be  zero,  since  one  of  them  could  encounter  a 
bound  immediately.  In  either  case,  the  values  of  dual  variables  might  also  change. 

D  Degenerate.  The  slack  is  basic  or  supcrbasic,  but  it  is  equal  to  (or  very  close  to) 

one  of  its  bounds. 


6.4  Solution  Output 
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I  Infeasible.  The  slack  is  basic  or  superbasic  and  it  is  currently  violating  one  of  its 

bounds  by  more  than  the  FEASIBILITY  TOLERANCE. 

N  Not  precisely  optimal.  The  slack  is  nonbasic  or  superbasic.  If  the  OPTIMALITY 

TOLERANCE  were  tightened  by  a  factor  of  10  (c.g.,  if  it  were  reduced  from  10~5  to 
10-6),  the  solution  would  not  be  declared  optimal  because  the  reduced  gradient 
for  the  slack  would  not  be  considered  negligible.  (If  a  loose  tolerance  has  been 
used,  or  if  the  run  was  terminated  before  optimality,  this  key  might  be  helpful  in 
deciding  whether  or  not  to  restart  the  run.) 

Note:  If  SCALE  is  specified,  the  tests  for  assigning  the  A,  D,  I,  N  keys  are  made  on 
the  scaled  problem,  since  the  keys  are  then  more  likely  to  be  correct. 

ACTIVITY  The  row  value;  i.e.,  the  value  of  aTy  for  linear  constraints,  or  the  value  of  the 
linearization  Lf'(x)  +  aTy  if  the  constraint  is  nonlinear. 

SLACK  ACTIVITY  The  amount  by  which  the  row  differs  from  its  nearest  bound.  (For  free  rows, 
it  is  taken  to  be  minus  the  ACTIVITY.) 

LOWER  LIMIT  a,  the  lower  bound  on  the  row. 

UPPER  LIMIT  0,  the  upper  bound  on  the  row. 

DUAL  ACTIVITY  The  value  of  the  dual  variable  often  called  the  shadow  price  (or  simplex 
multiplier)  for  the  i-th  constraint.  The  full  vector  x  always  satisfies  BTx  =  gB, 
where  B  is  the  current  basis  matrix  and  gB  contains  the  associated  gradients  for 
the  current  objective  function. 

If  the  solution  is  feasible,  the  first  mi  components  of  x  are  used  at  the  start  of  the 
A:-th  major  iteration  to  define  X*,  the  estimate  of  the  Lagrange  multipliers  for  the 
nonlinear  constraints. 

I  The  constraint  number,  t. 

COLUMNS  Section 

Here  we  talk  about  the  “column  variables”  (x,y).  For  convenience  we  let  the  jf-th  component 

of  ( x,y )  be  the  variable  x}  and  assume  that  it  satisfies  the  bounds  «  <  x}  <  0.  Linear  and 

nonlinear  variables  are  treated  the  same. 

Label  Description 

NUMBER  The  column  number,  j.  This  is  the  internal  number  used  to  refer  to  x}  in  the 

iteration  log. 

COLUMN  The  name  of  z,. 

STATE  The  state  of  z;  relative  to  the  bounds  a  and  0.  The  various  states  possible  are  as 

follows. 

LL  ij  is  nonbasic  at  its  lower  limit,  a. 

UL  Xj  is  nonbasic  at  its  upper  limit,  0. 

EQ  Xj  is  nonbasic  and  fixed  at  the  value  n  =  0. 
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6.  Output 


FR  Xj  is  nonbasic  and  currently  zero,  even  though  it  is  free  to  take  any  value.  (Its 
bounds  are  a  =  —  oo,  0  =  +  oo.  Such  variables  arc  normally  basic.) 

BS  Xj  is  basic. 

SBS  Xj  is  supcrbasic. 

A  key  is  sometimes  printed  before  the  STATE  to  give  some  additional  information 
about  the  state  of  x}.  The  possible  keys  are  A,  D,  I  and  N.  They  have  the  same 
meaning  as  described  above  (for  the  ROWS  section  of  the  solution),  but  the  words 
“the  slack”  should  be  replaced  by  “zy”. 

ACTIVITY  The  value  of  the  variable  Xj. 

OBJ  GRADIENT  g]t  the  j-th  component  of  the  combined  linear  and  nonlinear  objective  function 
F(x)  +  cTx  +  dTy.  (We  define  g}  =  0  if  the  current  solution  is  infeasible.) 

LOWER  LIMIT  a,  the  lower  bound  on  zy. 

UPPER  LIMIT  0,  the  upper  bound  on  zy. 

REDUCED  GRADNT  The  reduced  gradient  d}  =  g3  —  ir^ay,  where  a,  is  the  j-th  column  of  the 
constraint  matrix  (or  the  j'-th  column  of  the  Jacobian  at  the  start  of  the  final 
major  iteration). 

M»J  The  value  m  +  j. 

An  example  of  the  printed  solution  is  given  in  chapter  8.  Infinite  UPPER  and  LOWER  LIMITS 
are  output  as  the  word  NONE.  Other  real  values  are  output  with  format  F16.5.  The  maximum 
record  length  is  1 11  characters,  including  the  first  (carriage-control)  character. 

/Vote:  If  two  problems  are  the  same  except  that  one  minimizes  F(x)  and  the  other  maximizes 
-F(x),  their  solutions  will  be  the  same  but  the  signs  of  the  dual  variables  zr,  and  the  reduced 
gradients  d}  will  be  reversed. 

6.S  SOLUTION  Fil« 

If  a  positive  SOLUTION  FILE  is  specified,  the  information  contained  in  a  printed  solution  may 
also  be  output  to  the  relevant  file  (which  may  be  the  I’RINT  file  if  so  desired).  Infinite  UPPER 
and  LOWER  LIMITS  appear  as  ±1020  rather  than  NONE.  Other  real  values  are  output  with  format 
1PE16.6.  Again,  the  maximum  record  length  is  III  characters,  including  what  would  be  the 
carriage-control  character  if  the  file  were  printed. 

A  SOLUTION  file  is  intended  to  be  read  from  disk  by  a  self-contained  program  that  extracts 
and  saves  certain  values  as  required  for  possible  further  compulation.  Typically  the  lir->t  II 
records  would  be  ignored.  Each  subsequent  record  may  be  read  using 

FORMAT (18,  2X,  2A4,  IX,  Al.  IX,  A3,  5E16.8,  17) 
adapted  to  suit  the  occasion.  The  end  of  the  ROWS  section  is  marked  by  a  record  that  starts 
with  a  1  and  is  otherwise  blank.  If  this  and  the  next  \  records  arc  skipped,  the  COLUMNS 
section  can  then  be  read  under  the  same  format.  (There  should  be  no  need  to  use  any  BACKSPACE 
statements.) 


6.6  SUMMARY  File 
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6.6  SUMMARY  Fit* 

If  SUMMARY  FILE  /  is  specified  with  /  >  0,  srtain  brief  information  will  be  output  to  file  /. 
When  MINOS  is  run  interactively,  file  /  will  usually  be  the  terminal.  For  batch  jobs,  a  disk  file 
should  be  used  to  retain  a  concise  log  of  each  run  (if  desired;  a  SUMMARY  file  is  more  easily 
perused  than  the  associated  PRINT  file). 

A  SUMMARY  file  (like  the  PRINT  file)  is  not  rewound  after  a  problem  has  been  processed.  It 
can  therefore  accumulate  a  log  for  every  problem  in  the  SPECS  file,  if  each  specifies  the  same  file. 
The  maximum  record  length  is  72  characters,  including  a  carriage-control  character  in  column  1. 
The  following  information  is  included: 

1.  The  BECIM  card  from  the  SPECS  file. 

2.  The  actual  number  of  rows,  columns  and  elements  in  the  MPS  file. 

3.  The  basis  file  loaded,  if  any. 

4.  The  status  of  the  solution  after  each  basis  factorization  (whether  feasible;  the  objective  value; 
the  number  of  function  calls  so  far). 

5.  The  same  information  every  Jfc-th  iteration,  where  k  is  the  specified  SUMMARY  FREQUENCY 
(default  k  =  100). 

6.  Warnings  and  error  messages. 

7.  For  nonlinear  constraints,  ||xk  +  i  -  Xk||,  ||X*+1  -  Xk|j  and  the  norm  of  the  nonlinear  constraint 
violation  at  the  start  of  each  major  iteration. 

8.  The  exit  condition  and  a  summary  of  the  final  solution. 

Item  4  is  preceded  by  a  blank  line,  but  item  5  is  not.  All  items  are  illustrated  in  Figure  6.1,  which 
shows  the  SUMMARY  file  for  the  test  problem  MANNE,  using  SUMMARY  FREQUENCY  1. 


NINOS  I  S.O  DEC  IMS  } 

BESIN  MAMC10 
ROWS  tl 

coums  JO 

ELENEHTS  50 

XXXX  NARMINS  -  THE  RMS  XS  ZERO 

XXXX  TOTAL  NO.  Of  ERRORS  XH  MRS  PILE  t 

***  FUNCON  SETS  7  OUT  OP  10  CONSTRAINT  GRADIENTS. 


START  OP  MAJOR  ITN  I  PENA  LIT  PARAMETER  *  1.000-01 

CONSTRAINT  VIOLATION  »  0.0 


ITN 

• 

SINP* 

1. 0000000000-03 

NINE* 

1 

ITN 

1 

SINP* 

1.0000000000-03 

NINE* 

1 

mmm 

PUNQOJ 

SETS 

17  OUT  OP 

to 

OBJECTIVE 

GRADIENTS. 

ITN 

1 

OBJ* 

1.0000007150*00 

PUNS* 

1 

5 

58* 

6 

ITN 

2 

OBJ* 

1.0005275560*00 

FUNS* 

30 

23 

SB* 

0 

OPTIMAL  SUB  PROBLEM  AT  MINOR  ITN  t  -  TOTAL  ITNS  « 


Figure  6.1.  Format  of  SUMMARY  file  for  test  problem  MANNE 


6.  Output 


START  OF  MAJOR  XTN  Z  PENALTY  PARAMETER  «  1.000-SI 

CHANGE  IN  JACOBN  VARS  *  3. 33330-02 

CHANGE  IN  MULTIPLIERS  *  9.06430*00 

CONSTRAINT  VIOLATION  «  9.17350-06 


ITN 

2 

OBJ* 

2.6697308970*00 

FUNS* 

31 

24 

SB* 

5 

ITN 

3 

OBJ* 

2.6698262040*00 

FUNS* 

40 

33 

SB* 

7 

ITN 

4 

OBJ* 

2.6700226040*00 

FUNS* 

47 

40 

SB* 

7 

OPTIMAL  SUB  PROBLEM  AT  MINOR  ITN  t  •  TOTAL  XTN3  ■  4 


START  OF  MAJOR  ITN  3  PENALTY  PARAMETER  *  I. 000-01 

CHANGE  IN  JACOBN  VARS  *  1.67010-02 

CHANGE  IN  MULTIPLIERS  *  1. 42060-02 

CONSTRAINT  VIOLATION  *  E. 76 700-06 


ITN 

4 

OBJ* 

2.6700226270*00 

FUNS* 

46 

41 

SB* 

7 

ITN 

5 

OBJ* 

2.6700636790*00 

FUNS* 

59 

52 

SB* 

7 

ITN 

6 

OBJ* 

2.6700803560*00 

FUNS* 

64 

57 

SB* 

7 

ITN 

7 

OBJ* 

2.6700880090*00 

FUNS* 

69 

62 

SB* 

7 

ITN 

8 

OBJ* 

2.6700926440*00 

FUNS* 

76 

69 

SB* 

7 

ITN 

9 

OBJ* 

2.6700976020*00 

FUNS* 

62 

75 

SB* 

7 

ITN 

10 

OBJ* 

2.6700976670*00 

FUNS* 

69 

62 

SB* 

7 

ITN 

11 

OBJ* 

2.6700976670*00 

FUNS* 

94 

67 

SB* 

7 

OPTIMAL 

SUBPROBLEM  AT  MINOR  ITN 

7  -  TOTAL  ITNS 

* 

11 

START  OF  MAJOR  ITN  4  PENALTY  PARAMETER  *  0.0 

CHANGE  IN  JACOBN  VARS  «  1.52510-02 

CHANGE  IN  MULTIPLIERS  *  5.72510-03 
CONSTRAINT  VIOLATION  *  2.01700-06 

ITN  11  OBJ*  2.6700976560*00  FUNS*  95  66  SB*  7 

ITN  12  OBJ*  2.6700976560*00  FUNS*  103  96  SB*  7 

OPTIMAL  SUB  PROBLEM  AT  MINOR  ITN  1  -  TOTAL  ITNS  *  12 


START  OF  MAJOR  ITN  5  PENALTY  PARAMETER  *  0.0 

CHANGF  IN  JACOBN  VARS  *  4.01140-06 

CHANGE  IN  MULTIPLIERS  «  9.60640-07 

CONSTRAINT  VIOLATION  ■  1.43540-13 

1 

EXIT  —  OPTIMAL  SOLUTION  FOUK) 

MAJOR.  MINOR  ITNS  5  12 

OBJECTIVE  FUNCTION  2.67009765764300*00 

SUPERBASICS.  R6N0RM  7  2.4ID-09 

XNORN.  PXNORH  5.100*00  7.610*00 

FUNQBJ.  F UNCON  CALLS  103  96 

BASIS  NAP  SAVED  ON  FILE  11  ITN  *  12 

SOLUTION  PRINTED 

F UNCON  CALLEO  WITH  NSTATE  «  2 

FUNOBJ  CALLEO  WITH  NSTATE  a  2 


Figure  8.1  (continued).  Format  of  SUMMARY  file  for  test  problem  MANNE 
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7.  SYSTEM  INFORMATION 


7.1  Distribution  Tape 

The  source  code  and  test  problems  for  MINOS  are  distributed  on  a  magnetic  tape  containing 
14  files.  The  tape  characteristics  are  described  in  a  document  accompanying  the  tape;  normally 
they  are:  9  track,  1600  bpi,  unlabeled,  ASCII,  80-character  records  (card  images),  3600-character 
blocks. 

The  following  is  a  list  of  the  files  and  a  summary  of  their  contents.  For  reference  purposes 
we  give  a  name  to  each  file.  However,  the  names  will  not  be  recorded  on  unlabeled  tapes.  The 
HEAD  and  BODY  files  are  composed  of  several  smaller  files  described  in  section  7.2. 


File 

Name 

Type 

Cards 

Description 

1. 

HEAD1 

FORTRAN 

923 

Source  files  1  2:  MIOOMAIN  and  MI10MACH 

2. 

B0DY1 

FORTRAN 

12846 

Source  files  3  13:  MI15BLAS  thru  MI80NC0N 

3. 

HEAD2 

FORTRAN 

923 

4. 

B0DY2 

FORTRAN 

12846 

5. 

HEAD3 

FORTRAN 

923 

6. 

B0DY3 

FORTRAN 

12846 

7. 

MANNE 

DATA 

146 

SPECS  and  MPS  files  for  test  problem  MANNE 

8. 

WEAPON 

FORTRAN 

56 

Double-precision  file  MIOOMAIN  for  WEAPON 

9. 

WEAPON 

SINGLE 

56 

Single-precision  version  of  file  8 

10. 

WEAPON 

DATA 

151 

SPECS  and  MPS  files  for  WEAPON 

It. 

ETAMACRO 

FORTRAN 

135 

Double-precision  file  MIOOMAIN  for  ETAMACRO 

12. 

ETAMACRO 

SINGLE 

135 

Single-precision  version  of  file  11 

13. 

ETAMACRO 

SPECS 

38 

SPECS  file  for  ETAMACRO 

11. 

ETAMACRO 

MPS 

2134 

MPS  file  for  ETAMACRO 

One  HEAD  and  one  BODY  file  should  be  selected  for  any  given  installation.  HEAD1  and  B0DY1 
are  intended  for  machines  using  Fortran  declarations  of  the  form 
IMPLICIT  REAL* 8 (A-H, 0-Z) 

DOUBLE  PRECISION  Z(NWCORE) 

INTEGER  KA(NKA)  (long  integers) 

INTEGER *2  HA(NE)  (short  integers) 

For  example:  IBM  Systems  360,  370,  3033,  3081,  etc.;  Amdahl  170,  Facom,  Fujitsu,  Hitachi,  and 
other  systems  analogous  to  IDM;  DEC  VAX  11/750  and  11/780;  Data  General  MV/8000;  ICL 
2900  scries;  recent  PRIME  systems. 

HEAD 2  and  B0DY2  are  intended  for  machines  using  Fortran  declarations  of  the  form 
IMPLICIT  DOUBLE  PRECISION (A-H, 0-Z) 

DOUBLE  PRECISION  Z(NWCORE) 

INTEGER  KA(NKA)  (long  integers  only) 

For  example:  DEC  Systems  10  and  20;  Honeywell  systems;  Univac  1100  series. 

HEAD 3  and  B0DY3  arc  intended  for  machines  using  Fortran  declarations  of  the  form 
REAL  Z(NWCORE) 

INTEGER  KA(NKA) 

For  example:  Burroughs  6700  and  7700  series;  OI)C  6000  and  7000  series  and  their  Cyber 
counterparts;  Cray-1. 
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Installation  Procedure 

1.  Obtain  the  appropriate  HEAD  and  BODY  files  From  the  tape,  along  with  the  test  data  in  file  7 

(MANNE  DATA). 

2.  Split  the  HEAD  file  into  file  MIOOMAIN  and  file  MI10MACH  as  suggested  in  section  7.2. 

3.  If  necessary,  edit  the  subroutines  in  MIIOMACH  according  to  section  7.4. 

4.  Decide  whether  or  not  to  split  the  BODY  file  into  files  MI15BLAS  through  MI80NC0N  as  suggested 
in  section  7.2. 

5.  If  all  source  code  must  be  compiled  together  (e.g.,  with  the  Watfiv  compiler),  compile  all  the 
routines  that  were  originally  in  the  HEAD  and  BODY  files,  and  run  them  on  the  test  data  in  file 
MANNE  DATA.  Check  the  output  against  that  shown  in  section  8.4. 

6.  If  all  source  code  can  be  compiled  together  and  saved  as  a  load  module,  and  if  various  routines 
can  later  be  compiled  and  linked  to  the  load  module,  then  do  as  described  in  step  5. 

7.  If  individual  routines  cannot  be  recompiled  to  replace  those  in  an  already  compiled  collection, 
it  is  essential  to  compile  ‘.he  four  routines  in  file  MIOOMAIN  separately;  these  contain  the  default 
user  routines  (appropriate  for  the  test  problem  MANNE),  and  they  will  be  replaced  for  other 
problems.  Compile  all  remaining  HEAD  and  BODY  routines  together  (or  separately  if  more 
convenient).  In  some  circumstances  it  may  be  desirable  to  keep  subroutines  MIFILE,  MIN0S1 
and  MIN0S2  separate.  Run  the  resulting  code  on  the  test  data  in  file  MANNE  DATA,  and  check 
the  output  against  that  shown  in  section  8.4. 

8.  If  further  testing  is  desired,  compile  the  appropriate  WEAPON  FORTRAN  file  and  link  it  to  the 
previously  compiled  MINOS  code.  Run  it  on  the  SPECS  and  MPS  files  contained  in  WEAPON 
DATA.  Sec  section  7.6  for  a  summary  of  the  test  problem  results. 

9.  For  a  more  demanding  test,  perform  the  same  steps  on  the  three  relevant  EIaMACRO  files. 


7.2  Source  Files 

The  source  code  for  MINOS  is  intended  to  be  acceptable  to  both  Fortran  66  and  Fortran  77 
compilers,  with  a  minimum  of  editing  required  for  any  particular  installation.  Certain  unavoidable 
machine  dependencies  are  confined  to  a  few  short  subroutines,  involving  file  definitions,  word 
lengths,  and  end-of-filc  recognition.  The  only  widespread  difficulty  arises  in  the  definition  of 
character  strings  in  DATA  statements  and  FORMAT  statements.  For  example, 

DATA  LWORD  /4HW0RD/ 

FORMAT (33H  FANCY  HAVING  TO  COUNT  CHARACTERS) 

is  accepted  by  most  Fortran  66  compilers,  but  may  result  in  warning  messages  from  Fortran  77 
compilers.  We  have  chosen  to  use  quotes  to  delimit  strings,  as  in 

DATA  LWORD  /’WORD’/ 

FORMAT <•  THIS  STRING  IS  EASY  TO  TYPE’) 

since  it  is  legal  in  Fortran  77  and  it  Tails  on  very  few  Fortran  66  compilers.  (In  the  past,  CDC 

compilers  have  allowed  strings  to  be  delimited  by  asterisks  (*)  rather  than  quotes.) 

DATA  statements  are  used  to  initialize  integer  variables  to  character  strings  in  the  manner 
just  shown.  The  strings  vary  from  1  to  4  characters  in  length.  Implicitly  typed  integers  arc 
therefore  assumed  to  be  at  least  32  bits  long.  On  some  systems  (e.g.,  PRIME)  this  means  that 
i  compiler  option  must  be  invoked  to  treat  implicit  integers  as  “long".  (Elsewhere  in  the  source 
ode.  variables  that  are  intended  to  be  16  bits  long  are  explicitly  typed  INTEGER*2.) 
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The  source  code  is  divided  into  13  logical  parts.  For  ease  of  handling,  these  are  combined  into 
the  HEAD  and  BODY  files  on  the  distribution  tape,  but  for  subsequent  maintenance  we  recommend 
that  13  separate  files  be  kept.  In  the  description  below  we  suggest  a  name  for  each  file  and 
summarize  its  purpose.  We  then  list  the  names  of  the  Fortran  subroutines  and  functions  involved. 
The  naming  convention  used  should  minimize  the  risk  of  a  clash  with  user-written  routines. 


File  1. 

MIOOUAIN 

Main  program  and  default  user  routines. 

MAIN 

FUNOBJ  FUNCON  MATMOD 

File  2. 

Mil ORACH 

Machine-dependent  routines. 

MIFILE 

MIH0S1  MIW0S2  M1HASH  M1INIT  if  1  READ 

File  3. 

MI15BLAS 

Basic  Linear  Algebra  Subprograms  (a  subset). 

DASUM  DAXPY  DCOPY  DDOT  DNRM2  DSCAL 

These  routines  are  functionally  similar  to  members  of  the  BLAS  package  (Lawson,  et  a/., 
1979).  Beware  that  they  perform  the  correct  function  only  when  the  parameters  INCX 
and  INCY  are  both  equal  to  l  (which  is  the  only  way  MINOS  uses  them).  If  possible  they 
should  be  replaced  by  authentic  BLAS  routines.  There  may  exist  versions  that  have 
been  tuned  to  your  particular  machine. 

DZERO  HCOPY  ICOPY 

These  are  additional  utility  routines  that  could  be  tuned  to  your  machine.  DZERO  is  used 
the  most,  to  set  a  vector  to  zero.  If  tuned  versions  of  the  BLAS  are  available,  DZERO 
could  call  DCOPY  with  appropriate  arguments. 

File  4. 

MI20AMAT 

Constraint  matrix  routines. 

M2APRD 

M2UNP2 

M2APR5  M2APR7  M2APR8  M2BSPR  M2CRSH  M2SCAL 
MATCOL 

M2UNPK 

File  5. 

MI25BFAC 

Basis  factorization  routines. 

LU1FAC 

LU6S0L 

M2SING 

LU2FAC  LU3CP  LU4AC  LU4AR  LU5P01  LU5PQ2 

LU71IVR  LU7MVW  LU8RPC  M2BELM  M2BFAC  M2BMAP 

LU5PQ3 

M2BS0L 

File  6. 

MI30SPEC 

SPECS  file  routines. 

M3SPC0 

M3SPC1  M3SPC2 

File  7. 

1II35INPT 

Storage  allocation  and  MPS  file  input. 

M3C0RE 

M3INPT  U3UPS  M3NAME  M3READ 

File  8. 

MI40BFIL 

BASIS  file  input/output  and  SOLUTION  printing. 

M4GETB 

M4S0LN 

M4DUMP  M4INST  M4L0AD  M4NEWB  M40LDB  M4PNCH 
M4S0L1  M4S0L2 

M4SAVB 

File  9. 

MI50LP 

Primal  simplex  method. 

M5CHZR 

K5FR UC  M5L OC  M5LPIT  R5PRIC  U5SETP  USSETX 

USSOLV 
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File  10.  MI60SRCH  Linesearch  and  merit  function. 

GETPTC  GETPTQ  MERFUN  MERGRD  MERSAV  SEARCH  M6DC0N  M6D0BJ 

M6DMMY  M6FC0N  M6F0BJ 

File  11.  MI65RM0D  Maintaining  the  quasi-Newton  factor  R. 

M6BFGS  M6BSWP  M8RADD  M6RCND  M6RDEL  M6RM0D  M6RSET  M6RS0L 

1I6SWAP 

File  12.  MI70NOBJ  Nonlinear  objective;  reduced-gradient  algorithm. 

M7BSG  M7BSX  M7CHKD  M7CHKG  M7CHZQ  M7RG  M7RGIT  M7SDIR 

M7SSCV 

File  13.  MI80NC0N  Nonlinear  constraints ;  projected  Lagrangian  algorithm. 

U8AJAC  M8AUGL  M8AUG1  M8CHKJ  M8PRTJ  II8SETJ 

7.S  COMMON  Blocks 

Certain  Fortran  COMMON  blocks  are  used  in  the  MINOS  source  code  to  communicate  between 
subroutines.  Their  names  are  listed  below. 


M1EPS 

M1FILE 

M1W0RD 

M2FILE 

M2LU1 

M2LU2 

M2LU3 

M2MAPA 

M2MAPZ 

M2PARM 

M3LEN 

M3LOC 

M3MPS1 

M3NPS2 

M3MPS3 

M3MPS4 

M3SCAL 

M5LEN 

M5LP2 

M5L0C 

M5PRC 

M5FREQ 

M5T0LS 

MSLOBJ 

M5L0G1 

M5L0G2 

M5L0G3 

M5LP1 

M7LEN 

M7L0C 

M7CG1 

M7CG2 

M7C0NV 

M7PHES 

M7T0LS 

M8LEN 

CYCLCM 

M8L0C 

M8AL1 

M8AL2 

M8DIFF 

M8FUNC 

M8SAVE 

M8VERI 

A  complete  listing  of  the  COMMON  blocks  and  their  contents  appears  in  subroutine  MIN0S2.  (Also 
see  section  2.6).  It  may  be  convenient  to  make  use  of  these  occasionally;  for  example, 

COMMON  /Ml FILE/  IREAD, IPRINT, ISUMM 

gives  the  file  numbers  for  the  system  reader  and  printer  and  for  the  Sl'MM.MtY  tile.  Otherwise, 
the  naming  convention  should  again  minimize  the  risk  of  a  clash  with  user- di  lined  COMMON  blocks 
and  subroutines. 

As  supplied,  MINOS  does  not  use  blank  COMMON.  However,  in  some  installations  it  may  be 
desirable  to  store  the  workspace  array  Z  there,  as  noted  in  the  next  section. 
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7.4  Machine- dependant  Subroutines 

Some  of  the  routines  in  the  HEAD  file  may  require  modification  to  suit  a  particular  machine  or  a 
non-standard  application.  We  discuss  each  of  them  in  turn. 


The  Main  Program 

The  workspace  for  MINOS  is  allocated  in  the  main  program  by  code  of  the  following  form: 

DOUBLE  PRECISION  Z (10000) 

DATA  NWCORE/ 10000/ 

C 

CALL  MINOS 1 (  Z. NWCORE  ) 

RETURN 

C 

C  END  OF  UAIN 
END 

Ten  thousand  words  of  storage  are  sufficient  to  solve  small  examples  such  as  the  test  prob¬ 
lems  MANNE  and  WEAPON.  About  25000  words  are  needed  for  ETAMACRO,  which  has  ap¬ 
proximately  400  constraints  and  700  variables.  For  linear  programs  containing  m  constraints,  the 
length  of  Z  should  be  roughly  100m,  depending  on  the  density  of  the  constraint  matrix.  Nonlinear 
programs  may  require  more  workspace  if  there  are  many  nonlinear  variables. 

On  some  machines  it  is  possible  to  replace  the  main  program  by  a  non-Fortran  routine  that 
allocates  storage  for  Z  at  run-time. 

For  Burroughs  installations,  the  main  program  should  allocate  Z  by  calling  an  Algol  procedure 
GETC0R  (not  provided),  which  in  turn  should  call  MIN0S1  as  above.  This  will  overcome  two 
problems  in  the  process: 

1.  The  binder  can  replace  GETC0R  in  a  compiled  code  file  (but  it  cannot  replace  the  main 
program). 

2.  The  length  of  Z  is  effectively  unlimited  if  declared  in  an  Algol  procedure  (but  is  restricted  to 
be  65535  or  less  when  declared  in  Fortran). 

In  some  installations  it  will  be  desirable  to  put  Z  in  blank  COMMON  and  then  extend  it  at 
run-time  if  necessary.  This  could  be  done  in  UAIN,  or  in  subroutine  MIN0S2  (see  below). 

On  Honeywell  machines,  Z  must  be  in  blank  or  labeled  COMMON  to  avoid  a  limit  on  the  tola! 
storage  for  local  variables  (18K  words). 

The  CDC  version  of  MAIN  will  need  to  begin  with  PROGRAM  cards  of  the  following  general 
form: 

PROGRAM  MINOS (  INPUT.  OUTPUT.  TAPE5=INPUT,  TAPE6= OUTPUT, 

1  TAPES.  TAPE9,  TAPE10,  TAPE1 1 , 

2  TAPE12,  TAPE13,  TAPE14,  TAPE15  ) 

The  unit  numbers  are  suggested  for  use  as  follows: 

TAPES  The  SCRATCH  file  (record  length  8) 

TAPE9  A  SUMMARY  file  (e.g.,  a  terminal) 

TAPE10  An  MTS  file 

TAPE  11  An  OLD  BASIS  file  and/or  a  BACKUP  file 

TAPE12  A  NEW  BASIS  file 
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TAPE13  An  INSERT  file  or  a  LOAD  file 
TAPE14  A  PUNCH  file  or  a  DUMP  file 
TAPE16  A  SOLUTION  file  (record  length  111) 


Subroutines  FUNOBJ,  FUNCON,  MATMOD 

These  are  the  user  routines  described  in  Chapter  2.  The  HEAD  file  contains  default  versions 
that  are  appropriate  for  the  test  problem  MANNE.  They  test  if  PROBLEM  NUMBER  1111  has  been 
specified,  as  in  the  file  MANNE  DATA.  If  not,  they  terminate  the  run  with  a  message  indicating  that 
the  required  subroutine  has  not  been  loaded.  (See  exit  6  in  section  6.3.) 


Subroutine  MIFILE 

This  subroutine  assigns  explicit  unit  numbers  to  certain  global  files,  namely  the  “card  reader”, 
the  “line  printer",  the  SCRATCH  file,  and  the  SPECS  file.  Typical  values  are  5,  6,  8,  and  B,  but 
these  will  not  be  suitable  for  all  installations. 

In  some  cases  (e.g.,  DEC  10  and  20),  MIFILE  must  use  explicit  OPEN  statements  to  open  both 
the  global  files  and  certain  others  that  are  defined  in  the  SPECS  file  for  a  particular  problem,  and 
to  assign  symbolic  names  to  these  files.  In  such  cases,  it  may  be  sensible  to  let  the  user  compile 
his  own  version  of  MIFILE  each  time  MINOS  is  run. 

For  Burroughs  installations,  MIFILE  may  need  to  be  compiled  separately  with  some  Burroughs 
FILE  statements  inserted  at  the  start  (since  they  must  be  the  first  statements  that  the  compiler 
sees).  The  attributes  in  these  FILE  statements  can  be  altered  by  the  usual  WFL  statements 
associated  with  a  run,  but  their  default  values  cannot  be  altered  by  binding  in  a  dilTcrcnt  version 
of  MIFILE.  It  is  therefore  advisable  to  consider  the  FILE  statements  carefully  before  compiling 
the  entire  source  code. 


Subroutine  MIN0S1 

This  opens  some  global  files  and  then  passes  the  array  Z  to  subroutine  MIN0S2  as  many  times  as 
necessary,  until  a  signal  is  given  that  all  problems  in  the  SPECS  file  have  been  processed. 

For  special  applications,  MIN0S1  may  need  to  be  expanded.  The  most  likely  extension  would 
be  to  call  a  matrix  generator  and  a  report  writer  (before  and  after  the  call  to  subroutine  MIN0S2). 


Subroutine  MIN0S2 

For  special  applications,  MIN0S2  may  require  modification.  Again,  one  may  wish  to  insert  calls  to 
a  matrix  generator  or  a  report  writer. 

Some  systems  (e.g.,  CDC)  allow  blank  COMMON  to  be  extended  at  run-time.  If  so,  a  sensible 
place  to  do  this  is  after  the  call  to  M3C0RE,  making  use  of  the  integer  variables  NWCORE,  MINCOR 
and  MAXZ.  MINCOR  will  contain  an  estimate  of  the  amount  of  storage  required,  and  the  user  may 
assign  a  value  to  MAXZ  by  means  of  a  data  card  of  the  form 

WORKSPACE  (TOTAL)  50000 

in  the  SPECS  file.  See  the  in-line  documentation  for  further  details. 
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Subroutine  U1HASH 

This  subroutine  should  not  require  modification  if  a  word  containing  Tour  characters  of  left- 
justified  data  (read  under  A4  format)  can  be  treated  as  a  valid  INTEGER. 

On  certain  machines  that  regard  INTEGER  variables  as  a  subset  of  the  REALs,  the  characters 
must  be  right-shifted  in  order  to  produce  a  zero  floating-point  exponent.  The  in-line  documenta¬ 
tion  points  to  four  words  requiring  conversion. 

For  CDC  and  Cray  installations,  an  offending  word  KEY1  may  be  converted  into  an  acceptable 
integer  K1  as  follows: 

DECODEC  4.10.KEY1  )  K1 
10  FORMAT (R4) 

For  Burroughs  machines,  the  following  statement  has  the  required  effect  if  KZERO  =  0: 

K1  =  CONCATC  KZERO , KEY1 .31,47,32  ) 

Burroughs  installations  need  some  further  non-standard  Fortran  to  facilitate  character  com¬ 
parisons.  In  M1HASH,  the  statement 

IF  (KEYl  .EQ.  NAMEl(KT)  .AND.  KEY2  .EQ.  NAME2 (KT) )  GO  TO  60 
must  be  changed  to  use  “.IS.”  in  place  of  “.EQ.”,  and  the  same  change  must  be  made  to  many 
“.EQ.”  tests  in  subroutine  M3SPC1  (in  the  BODY  file). 

Subroutine  M1INIT 

The  variable  EPS  in  this  subroutine  should  be  set  to  the  relative  precision  of  the  machine’s 
floating-point  arithmetic,  when  it  operates  on  words  of  the  same  type  as  the  main  storage  array 
Z.  Typical  values  are  as  follows: 


EPS 

= 

ie.o**(-i3) 

for  IBM  systems, 

EPS 

= 

2.0** (-55) 

for  DEC  VAX  1 1  /780  with  standard  double  precision, 

EPS 

= 

2.0** (-61) 

for  DEC  10  and  20, 

EPS 

= 

2.0** (-62) 

for  Honeywell  systems, 

EPS 

= 

2.0**(-59) 

for  Univac  systems, 

EPS 

= 

2.0** (-47) 

for  CDC  and  Cray  systems, 

EPS 

= 

2 .0** (-37) 

for  Burroughs  systems. 

Some  VAX  systems  have  additional  double-precision  hardware  with  slightly  lower  precision  but  a 
greater  exponent  range.  Use  of  this  option  may  be  worthwhile,  since  it  will  essentially  eliminate 
some  annoying  (but  otherwise  harmless)  occurrences  of  floating-point  underflow. 

Subroutine  M1READ 

This  subroutine  contains  a  READ  statement  that  is  required  to  recognize  an  end-of-file  condition 
(when  reading  the  SPECS  file).  Most  compilers  allow  the  form 
READCISPECS,  1000,  END =900)  L, LINE 
RETURN 

but  CDC  compilers  require  the  statements 

READUSPECS,  1000)  L.LINE 
IF  (EOF(ISPECS))  900.  100 
100  RETURN 

Note:  Once  installed  correctly,  subroutines  M1HASH,  M1INIT  and  M1READ  will  not  be  changed 
by  the  user.  They  should  be  treated  the  same  as  the  subroutines  in  the  BODY  file. 
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7.5  Subroutine  Structure 

The  first  five  levels  of  the  subroutine  hierarchy  are  shown  below. 


1.  The  main  program  allocates  workspace  and  calls  MIN0S1. 

2.  MINOS  1  defines  the  READ,  PRINT,  SCRATCH  and  SPECS  files  via  MIFILE,  then  calls  MIN0S2 
once  for  each  problem  in  the  SPECS  file. 

3.  NIN0S2  inputs  the  SPECS  file  and  the  MPS  file,  loads  an  initial  basis,  solves  the  problem 
(or  a  sequence  of  problems  according  to  the  CYCLE  LIMIT),  and  finally  saves  RASIS  files  and 
prints  the  solution. 


i 
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7.6  Test  Problem* 


Test  Problem  MANNE 

This  is  a  small  example  of  an  economic  model  due  l.o  Marine  (1979).  It  has  a  nonlinear  objective 
function,  10  nonlinear  constraints,  10  linear  constraints,  and  30  variables.  The  nonlinearities  are 
defined  by  the  default  function  routines  FUNOBJ  and  FUNCON  in  the  MINOS  source  code.  The 
starting  point  given  in  the  MPS  file  is  intentionally  close  to  the  optimum  solution,  to  make  this 
an  inexpensive  test  problem.  Other  values  in  the  INITIAL  bounds  set  can  be  tried. 

As  supplied,  FUNOBJ  and  FUNCON  compute  all  gradients  analytically  if  the  SPECS  file  specifics 
DERIVATIVE  LEVEL  3.  For  test  purposes,  the  first  three  nori/.ero  gradients  in  each  routine  are  not 
computed  if  DERIVATIVE  LEVEL  =  0.  We  give  a  summary  of  the  output  produced  by  MINOS  for 
the  latter  case.  A  full  listing  appears  in  section  8.4. 

For  this  and  later  examples,  the  results  were  obtained  on  an  IBM  3081  using  the  Fortran  II 
Extended  (Enhanced)  compiler  with  optimisation  level  0PT=3. 


Maximum  objective  value:  2.67009603 

Iterations  to  get  feasible:  1 

Total  iterations:  14 

Major  iterations:  3 

Evaluations  of  F(x)  and  its  gradient:  21 

Evaluations  of  f(x)  and  its  Jacobian:  24 

Number  of  superbasics  at  optimum:  7 

CPU  lime  (IBM  3081):  0.3  seconds 


Th«  Weapon  Assignment  Problem,  WEAPON 

This  problem  has  a  nonlinear  objective  function  and  linear  constraints.  Ii  is  described  by  Bracken 
and  McCormick  (1969)  and  Himmclblau  (1972).  The  constraint  matrix  is  12  x  100  and  all  100 
variables  occur  nonlincarly  in  the  objective  function  i'{x).  The  latter  depends  on  12  data  cards 
which  arc  read  during  the  first  entry  to  subroutine  FUNOBJ. 

The  following  are  some  solution  statistics,  obtained  by  MINOS  on  an  IBM  3081  as  noted 
above.  They  give  an  indication  of  the  cfTort  required  to  solve  the  problem.  However,  one  should 
not  expect  to  obtain  identical  results  on  some  other  machine. 


Minimum  objective  value:  -1735.56958 

Iterations  to  get  feasible:  3 

Total  iterations:  120 

Evaluations  of  F{x)  and  its  gradient:  270 

Number  of  superbasics  at  optimum:  18 

CPU  time  (IBM  3081):  2  seconds 
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7.  System  Information 


Test  Problem  ETAMACRO  (linear  version) 

This  is  one  example  of  the  energy  model  developed  by  Manne  (1977).  The  constraint  matrix  is 
401  X  889.  To  obtain  a  linear  problem,  we  have  included  one  linear  objective  row  OPTIMALC  in 
the  MPS  file.  The  latter  also  contains  one  right-hand-side  vector  RHS00001,  and  one  bounds  set 
B0UNDS01. 

The  objective  row  OPTIMALG  contains  the  optimal  gradient  values  for  the  80  nonlinear  vari¬ 
ables  in  the  original  (nonlinear)  form  of  ETAMACRO.  Hence  the  linear  version  of  the  problem  haa 
the  same  optimal  dual  variables  x  as  the  nonlinear  version  (but  rather  different  primal  variables 
x). 

The  file  ETAMACRO  SPECS  is  set  up  to  solve  this  linear  program  first.  It  asks  for  the  linear 
variables  and  constraints  to  be  scaled.  (Note  that  it  also  asks  for  a  BASIS  map  to  be  saved  on 
unit  11  every  100  iterations.  This  may  be  used  as  a  starting  basis  for  the  nonlinear  version  of  the 
problem.) 

Typical  solution  statistics  follow. 


Maximum  objective  value:  755.715213 

Iterations  to  get  feasible:  240 

Total  iterations:  904 

CPU  time  (rBM  3081):  15  seconds 

Test  Problem  ETAMACRO  (nonlinear  version) 


The  objective  function  for  the  original  form  of  the  energy  model  is  entirely  nonlinear,  and  involves 
the  first  80  variables.  It  is  defined  by  subroutine  FUNOBJ  in  file  ETAMACRO  FORTRAN.  It  depends 
on  3  data  cards  which  are  included  at  the  end  of  file  ETAMACRO  SPECS  and  are  read  during  the 
first  entry  to  FUNOBJ. 

The  MI’S  file  docs  not  initialize  any  of  the  nonlinear  variables.  When  started  from  the  optimal 
solution  to  the  preceding  linear  problem,  typical  solution  statistics  (with  scaling  requested)  are 
as  follows. 


Maximum  objective  value:  1337.72468 

Iterations  to  get  feasible:  0 

Total  iterations:  235 

Evaluations  of  F(x)  and  its  gradient:  444 

Number  of  superbasica  at  optimum:  28 

CPU  time  (IBM  3081):  7  seconds 


Prom  a  cold  start,  with  and  without  scaling,  typical  statistics  are  as  follows. 


SCALE  YES  SCALE  NO 

Maximum  objective  value:  1337.72468  1337.72468 

Iterations  to  get  feasible:  235  213 

Total  iterations:  1022  1267 

Evaluations  of  F(x)  and  its  gradient:  1271  1554 

Number  of  supcrbasics  at  optimum:  28  28 

CPU  time  (IBM  3081):  21  seconds  28  seconds 


7.6  Test  Problems 
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t.  EXAMPLES 

The  following  sections  define  some  example  problems  and  show  the  input  required  to  solve  them 
using  MINOS.  The  last  example  in  section  8.4  is  test  problem  MANNB  as  supplied  on  the 
distribution  tape.  For  this  example  we  also  give  the  output  produced  by  MINOS. 

As  the  examples  show,  certain  Fortran  routines  may  be  required  to  run  a  particular  problem, 
depending  on  the  problem  and  on  the  Fortran  installation: 

•  A  main  program  to  allocate  workspace 

•  Subroutine  FUNOBJ  to  define  a  nonlinear  objective  function  (if  any) 

•  Subroutine  FUNCON  to  define  nonlinear  constraint  functions  (if  any) 

•  Subroutine  MATMOD  for  special  applications 

The  following  input  items  are  always  required: 

•  A  SPECS  file 

•  An  MPS  file 

Additional  input  may  include  a  BASIS  file  and  data  read  by  the  Fortran  routines. 

Load  modules  and  file  specifications  are  inevitably  machine-dependent.  A  resident  expert 
will  be  needed  to  install  MINOS  on  your  particular  machine  and  to  recommend  job  control  or 
operating  system  commands.  On  some  machines  it  will  be  possible  to  run  linear  programs  through 
MINOS  without  compiling  any  routines  or  linking  them  to  the  MINOS  code  file.  For  nonlinear 
problems,  some  compilation  and  linking  is  unavoidable. 

For  some  installations  it  may  also  be  convenient  to  have  your  own  copy  of  subroutine  UIFILE, 
to  define  certain  file  attributes  in  (non-standard)  Fortran,  rather  than  via  operating  system 
commands.  The  resident  expert  will  know  best. 

Good  luck!  We  hope  the  examples  that  follow  are  general  enough  to  set  you  on  the  right 
track. 


! 
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8.  Examples 


8.1  Linear  Programming 

One  of  the  classical  applications  of  the  simplex  method  was  to  the  so-called  diet  problem.  Given 
the  nutritional  content  of  a  selection  of  foods,  the  cost  of  each  food,  and  the  consumer’s  minimum 
daily  requirements,  the  problem  is  to  find  the  combination  that  is  least  expensive.  The  following 
example  is  taken  from  ChvAtal  (1983). 


where 


and 


minimize 

T 

c  X 

subject  to 

Ax  >  b, 

0  <  x 

< 

/no 

205 

160 

160  420 

260  \ 

I 

f  2000 

A=  4 

32 

13 

8  4 

H  I, 

6  = 

55 

V  2 

12 

54 

285  22 

80/ 

\ 

^  800 

=  ( 3  24 

13 

9  20 

19  )T, 

u  =  ( 4 

3  2  8 

2  2 

Main  program  (not  needed  for  some  installations) 

DOUBLE  PRECISION  Z( 10000) 
DATA  NWCORE/IOOOO/ 

C 

CALL  MIN0S1(  Z.NWCORE  ) 

STOP 

END 


Dummy  usar  routines  (not  needed  for  some  installations) 

SUBROUTINE  FUNOBJ 
ENTRY  FUNCON 
ENTRY  MATMOD 
RETURN 
END 


SPECS  File 

BEGIN  DIET  PROBLEM 
MINIMIZE 
ROWS 
COLUMNS 
ELEMENTS 

SUMMARY  FILE 
SUMMARY  FREQUENCY 
NEW  BASIS  FILE 
END  DIET  PROBLEM 


20 

30 

50 

9 

1  *  (for  email  problems  only) 

11 


8.1  Linear  Programming 
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MPS  Fit* 

NAME  DIET 

ROWS 


G 

ENERGY 

G 

PROTEIN 

G 

CALCIUM 

N 

COST 

COLUMNS 

OATMEAL 

ENERGY 

110.0 

PROTEIN 

4.0 

OATMEAL 

CALCIUM 

2.0 

COST 

3.0 

CHICKEN 

ENERGY 

20S.0 

PROTEIN 

32.0 

CHICKEN 

CALCIUM 

12.0 

COST 

24.0 

EGGS 

ENERGY 

180.0 

PROTEIN 

13.0 

EGGS 

CALCIUM 

54 . 0 

COST 

13.0 

MILK 

ENERGY 

160.0 

PROTEIN 

8.0 

MILK 

CALCIUM 

285.0 

COST 

9.0 

PIE 

ENERGY 

420.0 

PROTEIN 

4.0 

PIE 

CALCIUM 

22.0 

COST 

20.0 

PORKBEAN 

ENERGY 

260.0 

PROTEIN 

14.0 

PORKBEAN 

CALCIUM 

80.0 

COST 

19.0 

RHS 

DEMANDS 

ENERGY 

2000.0 

PROTEIN 

65.0 

DEMANDS 

CALCIUM 

800.0 

BOUNDS 

UP 

SERVINGS 

OATMEAL 

4.0 

UP 

SERVINGS 

CHICKEN 

3.0 

UP 

SERVINGS 

EGGS 

2.0 

UP 

SERVINGS 

MILK 

8.0 

UF 

SERVINGS 

PIE 

2.0 

UP 

SERVINGS 

PORKBEAN 

2.0 

ENDATA 

Notts  on  tht  Diet  Problem 

1.  For  small  problems  such  as  this,  the  SPECS  file  docs  not  really  need  to  specify  certain 
parameters,  because  the  default  values  are  large  enough.  However,  we  include  them  as  a 
reminder  for  more  substantial  models. 

2.  In  the  MPS  file  we  put  the  objective  row  last.  Looking  ahead,  this  is  one  way  of  ensuring 
that  it  does  not  get  mixed  up  with  nonlinear  constraints,  whose  names  must  appear  first  in 
the  ROWS  section. 

3.  The  constraint  matrix  is  unusual  in  being  100%  dense.  Most  models  have  at  least  a  few 
zeros  in  each  column  and  in  6.  They  would  not  need  to  appear  in  the  COLUMNS  and  III  IS 
sections. 

4.  MINOS  takes  three  iterations  to  solve  the  problem.  The  optimal  objective  is  cTx  =  92.5. 
The  optimal  solution  is  x  =  (4,  0,  0,  4.5,  2,  0)Tand  s  =  (0,  —5,  —  534.5 )T.  The  optimal 
dual  variables  are  x  =  (0.05625,  0,  0)T. 
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8.  Examples 


8.2  Unconstrained  Optimization 

The  following  is  a  classical  unconstrained  problem,  due  to  Rosenbrock  (1960): 

minimize  F(x)  =  100(za  —  za)J  +  (1  -  zi)a. 

We  use  it  to  illustrate  the  data  required  to  minimize  a  function  with  no  general  constraints. 
Bounds  on  the  variables  are  easily  included;  we  specify  — 10  <  x\  <  5  and  —10  <  xj  <  10. 


Calculation  of  F(x)  and  its  gradients 

SUBROUTINE  FUNOBJ (  MODE,  N,  X,  F,  G,  NSTATE,  NPROB.  Z.  NWCORE  ) 
IMPLICIT  REAL*0(A-H,O-Z) 

DOUBLE  PRECISION  X(N),  G(N) ,  Z(NWCORE) 

C 

C  ROSENBROCK 'S  BANANA  FUNCTION. 

C 


XI 

= 

X(l) 

X2 

= 

X(2) 

T1 

= 

X2  -  Xl**2 

T2 

= 

1.0  -  XI 

F 

= 

100.0  *  Tl**2  ♦  T2**2 

G(l) 

= 

-  400.0  *  T1  *  XI  -  2.0  *  T2 

0(2) 

= 

200.0  *  T1 

RETURN 

C  END  OF  FUNOBJ  FOR  ROSENBROCK 
END 


SPECS  Fils 

BEGIN  ROSENBROCK 

OBJECTIVE  =  FUNOBJ 
NONLINEAR  VARIABLES  2 
SUPERBASICS  LIMIT  3 

LOWER  BOUND  -10.0 

UPPER  BOUND  10.0 

SUMMARY  FILE  9 

SUMMARY  FREQUENCY  1 
ITERATIONS  LIMIT  50 
END  ROSENBROCK 


8.2  Unconstrair. .  1  Optimization 
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MPS  File 

NAME  ROSENBROCK 

ROWS 

N  DUMMYROW 
COLUMNS 
XI 
X2 

RHS 

BOUNDS 


UP 

BOUND 1 

XI 

5.0 

FX 

INITIAL 

XI 

-1.2 

FX 

INITIAL 

X2 

1.0 

ENDATA 

Notes  on  Rosenbrock’s  function 

1.  There  is  nothing  special  about  subroutine  FUNOBJ.  It  returns  the  function  value  F(x)  and 
two  gradient  values  g,  =  OF/dx}  on  every  entry.  If  G(l)  or  G(2)  were  not  assigned  values, 
MINOS  would  “notice”  and  proceed  to  estimate  either  or  both  by  finite  differences. 

2.  The  SPECS  file  apparently  does  not  need  to  estimate  the  dimensions  of  the  constraint  matrix 
A,  which  is  supposed  to  be  void  anyway.  But  in  fact.  MINOS  will  represent  A  as  a  1  X  n\ 
matrix  containing  rii  elements  that  are  all  zero.  For  very  large  unconstrained  problems,  the 
COLUMNS  and  ELEMENTS  keywords  must  be  specified  accordingly. 

3.  'I'he  SPECS  file  must  specify  the  exact  number  of  nonlinear  variables,  n|.  To  allow  a  little 
elbow  room,  the  SUPERBASICS  LIMIT  must  be  set  to  ni  +  1,  unless  it  is  known  that  some  of 
the  bounds  will  be  active  at  the  solution. 

■1.  The  MPS  file  must  specify  at  least  one  row.  Here  it  is  a  dummy  free  row  (type  N  =  non- 
binding  constraint).  The  basis  matrix  will  remain  H  =  I  throughout,  corresponding  to  the 
slack  variable  on  the  free  row. 

5.  The  COLUMNS  section  contains  just  a  list  oT  the  variable  names.  The  RHS  header  card 
must  appear,  but  a  free  row  has  no  right-hand-side  entry. 

6.  Uniform  bounds  — 10  <  x}  <  10  are  specified  in  the  SPECS  file  as  a  matter  of  good  practice. 
Their  presence  docs  not  imply  additional  work.  If  the  LOWER  and  UPPER  BOUND  keywords  did 
not  appear,  the  variables  would  implicitly  have  the  bounds  0  <  x;  <  oo,  which  wdl  not 
always  be  appropriate. 

7.  With  the  uniform  bounds  specified,  only  one  additional  card  is  needed  in  the  HOUNDS  sect  ion 
to  impose  the  restriction  Xi  <  5. 

8.  The  INITIAL  bound  set  illustrates  how  the  starting  point  (xi.xj)  =  (—1.2,  1.0)  is  specified. 
These  cards  must  appear  at  the  end  of  the  BOUNDS  section.  Since  the  SUPERBASICS  LIMIT 
is  sufficiently  high,  both  variables  will  initially  be  superbasic  at  the  indicated  values. 

9.  If  the  INITIAL  bound  set  were  absent  (and  if  no  BASIS  file  were  loaded),  Xj  and  i2  would 

initially  be  nonbasic  at  the  bound  that  is  smaller  in  absolute  value  (with  tics  broken  in  favor 
of  lower  bounds);  in  this  ease,  xt  —  ti|  =  5  and  x 2  =  =  —10. 

10.  From  the  standard  starting  point  shown,  a  quasi-Newton  method  with  a  moderately  accuru'c 
linesearch  takes  about  20  iterations  and  60  function  and  gradient  evaluations  to  reach  the 
unique  solution  X|  =  12  —  1.0. 
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8.  Example* 


1.1  Linearly  Constrained  Optimisation 

Quadratic  programming  (QP)  is  a  particular  case  of  linearly  constrained  optimisation,  in  which 
the  objective  function  F{x)  includes  linear  and  quadratic  terms.  There  is  no  special  way  of 
informing  MINOS  that  F(x)  is  quadratic,  but  the  algorithms  in  MINOS  will  tend  to  perform  more 
efficiently  on  quadratics  than  on  other  nonlinear  functions.  The  following  items  are  required  to 
solve  the  quadratic  program 


minimise  F(x)  =  \xTQx  +  cTx  subject  to  Ax  <  6,  x  >  0 

a 


for  the  particular  data 


-(Hi)  -0 


A  =  (  1  1  2),  6  —  3. 


Calculation  of  quadratic  term  and  its  gradients 

SUBROUTINE  FUNOBJ<  MODE,  N.  X.  F.  G.  ESTATE.  NPROB,  Z.  NWCORE  ) 
IMPLICIT  REAL*8 (A-H , 0-Z) 

DOUBLE  PRECISION  X(N) ,  G(N) .  Z(NVCORE) 

COMMON  /GPCOMM/  0(60,60) 

C 

C  Computation  of  F  =  1/2  x'Qx,  g  =  Ox. 

C  The  COMMON  statement  and  subroutine  SETQ  are  problem  dependent. 

C 

C 

IF  (NSTATE  .EQ.  1)  CALL  SETQ(  Q,  60.  N  ) 

F  =  0.0 

C 

DO  200  I  >  1,  I 
GRAD  =  0.0 
DO  100  J>  1,  I 

GRAD  e  GRAD  ♦  Q(I,J)«X(J) 

100  CONTINUE 

F  »  F  ♦  X(I) *GRAD 
G(I)  3  GRAD 
200  CONTINUE 
C 

F  3  0.6*F 

RETURN 


C 

C 


END  OF  FUNOBJ  FOR  QP 
END 


8.3  Llaemr/y  Constrained  Optimisation 


SPECS  Fife 

BEGIN  QP 

NONLINEAR  VARIABLES  3 

SUPERBASICS  LIMIT  3 

SUMMARY  FILE  0 

SUMMARY  FREQUENCY  1 

ITERATIONS  LIMIT  50 

END  QP 

MPS  Fife 


NAME 

RONS 

L  A 

N  C 

COLUMNS 

XI 

QP 

A 

1.0 

C 

-e.o 

X2 

A 

1.0 

C 

-0.0 

X3 

A 

2.0 

C 

-4.0 

RHS 

B 

ENDATA 

A 

3.0 

Notes  on  tho  QP  oxampfe 

1.  In  subroutine  FUNOBJ  we  assume  that  the  a. ray  Q(*,*>  is  initialised  during  the  first  entry 
by  another  subroutine  SETQ,  which  is  problem-dependent.  The  COMMON  statement  is  also 
problem-dependent  and  is  included  to  ensure  that  Q  will  retain  its  values  Tor  later  entries.  (In 
some  Fortran  implementations,  local  variables  are  not  retained  between  entries.) 

2.  The  quadratic  form  will  often  involve  only  some  of  the  variables.  In  such  cases  the  variables 
should  be  ordered  so  that  the  nonsero  rows  and  columns  of  Q  come  first,  thus: 

-(•  J 

3.  The  parameter  N  and  the  number  or  NONLINEAR  VARIABLES  would  then  be  the  dimension  of 

<3. 

4.  FUNOBJ  could  have  computed  the  linear  term  eTx  (and  its  gradient  c).  However  wc  have 
included  c  as  an  objective  row  in  the  MPS  file,  in  the  same  manner  as  for  linear  programs. 
This  is  more  general,  because  c  could  contain  entries  Tor  all  variables,  not  just  those  associated 
with  Q. 

5.  Beware — if  c  yk  0,  the  factor  |  makes  a  vital  difference  to  the  function  being  minimised. 

6.  The  optimal  solution  to  the  QP  problem  as  stated  is 

i*rQ*  =  8.2222, 


*  =  (1.3333,0.77777,0.44444), 


cTx  =  -17.111  F(x)  =  -8.8888. 


Tact  PhMmm  WEAPON  and  ETAMACRO 

The  MINOS  distribution  tape  contains  data  for  these  two  linearly  constrained  problems.  The 
SPECS  fils  for  ETAMACRO  is  as  follows.  It  is  set  up  to  solve  a  linear  form  of  the  problem  first, 
and  then  use  the  optimal  basis  as  a  starting  point  for  the  nonlinear  form. 
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Date-fitting  can  give  rise  to  a  eomtnlned  linear  Jeast-wpiarcs  problem  of  the  form 

Minimi—  |pTs  -  yds  subject  to  A*  >  t,  /<*<». 

This  ptohiom  may  be  solved  with  MINOS  as  it  stands,  by  coding  subroutine  FUM0BJ  to  compute 
the  objective  function  #*(s)  ■■  ||pfs  —  y|||  and  its  gradient  y(s)  *  x  -  y).  If  X  la  a  sparse 
matrix,  it  may  be  more  convenient  to  express  the  problem  in  the  form 

minimis*  f(r) -  |rrr  subject-  (7  ^)([)>(j)» 


r  free,  t  £  x  <|  *. 


8.3  Linearly  Constrained  Optimisation  93 


Not  as  on  tha  least-squares  problem 

1.  Aa  usual,  the  constraints  in  Ax  >  b  may  include  all  types  of  inequality. 

2.  r  =  y  —  Xx  is  the  residual  vector  and  rTr  is  the  sum  of  squares. 

3.  The  objective  function  is  easily  programmed  as  F(r)  =  \rTr  and  g(r)  —  r. 

4.  More  stable  methods  are  known  for  the  least-squares  problem.  If  there  are  no  constraints  at 
all,  several  codes  are  available  for  minimising  \\Xx  —  y||2  when  X  is  either  dense  or  sparse. 
When  there  are  equality  constraints  only  ( Ax  —  6),  we  know  of  one  specialised  method  that 
can  treat  X  and  A  as  sparse  matrices  (Bjorck  and  DufT,  1980).  For  the  more  general  case 
with  inequalities  and  bounds,  MINOS  is  one  of  very  few  systems  that  could  attempt  to  solve 
problems  in  which  X  and  A  are  sparse.  However,  if  n  (the  dimension  of  z)  is  very  large, 
MINOS  will  not  be  efficient  unless  almost  n  constraints  and  bounds  are  active  at  the  solution. 

5.  If  it  is  expected  that  most  of  the  elements  of  x  will  be  away  from  their  bounds,  it  will  be 
worthwhile  to  specify  MULTIPLE  PRICE  10  (say).  This  will  allow  up  to  10  variables  at  a  time 
to  be  added  to  the  set  currently  being  optimized,  instead  of  the  usual  1. 

Tho  Discrete  l\  Problem 

An  apparently  similar  data-fitting  problem  is 

minimize  ||Jfx  —  y||i  subject  to  Ax  >  b 

where  ||r||t  ==  £lr»l*  However,  this  problem  is  best  solved  by  means  of  the  following  purely 

linear  program: 

maximize  yTX  +  bTp 
K* 

subject  to  XT\  +  ATp  =  0,  —1  <  X*  <  l,  p  >  0. 


Notes  on  the  problem 

1.  The  solution  z  is  recovered  as  the  dual  variables,  i.c.,  the  Lagrange  multipliers  associated 
with  the  general  constraints. 

2.  The  optimal  value  of  \\Xx  —  yj|i  is  the  sum  of  the  absolute  values  of  the  reduced  costs 
associated  with  X.  (It  is  also  the  maxima!  value  of  yrX  +  bTp.) 

3.  If  a  particular  row  in  Ax  >  b  is  required  to  be  an  equality  constraint,  the  corresponding 
component  of  p  should  be  a  free  variable. 

4.  It  does  not  appear  rimple  to  include  the  bounds  l  <  z  <  u  except  as  part  of  Ax  >  b.  If 
there  are  many  finite  bounds,  it  may  be  best  to  solve  the  original  problem  directly  as  a  linear 
program,  thus: 

minimise  eTr  +  eTs 

c,» 

subject  to  ^  j  —  (y)'  T'  9  ~  *  -  *  -  *» 


where  eT  =  ( 1  l . . .  1 ). 
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8.4  Nonlinearly  Constrained  Optimization 

Two  example  problems  are  described  here  to  illustrate  the  subroutines  and  data  required  to  specify 
a  problem  with  nonlinear  constraints.  The  first  example  is  small,  dense  and  highly  nonlinear;  it 
shows  how  the  Jacobian  matrix  may  be  handled  most  simply  (as  a  dense  matrix)  when  there  are 
very  few  nonlinear  constraints  or  variables.  The  second  example  has  both  linear  and  nonlinear 
constraints,  and  illustrates  most  of  the  features  that  will  be  present  in  large-scale  applications 
where  it  is  essential  to  treat  the  Jacobian  as  a  sparse  matrix. 

Problem  MHW4D  (Wright  (1976),  example  4,  starting  point  D) 

minimise  (zt  -  1)*  +  (*i  —  *a)a  +  (*a  —  *s)8  +  (*3  -  *4)4  +  (*4  —  *s)4 

subject  to  %\  +  x\  +  z*  =  3^2  +  2, 
za  —  z*  +  *4  =  2>/2  —  2, 
zj  z5  =  2. 


Starting  point:  xq  =  (—1, 2, 1,  —2,  —2) 

Notes  for  problem  MHW4D 

1.  The  function  subroutines  include  code  for  a  second  problem  (Wright,  1976,  example  9).  The 
parameter  NPROB  is  used  to  branch  to  the  appropriate  calculation. 

2.  In  subroutine  FUNOBJ,  F  is  the  value  of  the  objective  function  F(x)  and  6  contains  the 
corresponding  5  partial  derivatives. 

3.  In  subroutine  FUNCON,  F  is  an  array  containing  the  vector  of  constraint  functions  f(x),  and 
G  holds  the  Jacobian  matrix;  thus,  the  i-th  row  of  G  contains  the  partial  derivatives  for  the 
i-th  constraint.  In  this  example  the  Jacobian  is  best  treated  as  a  dense  matrix,  so  C  is  a 
two-dimensional  array.  Note  that  several  elements  of  G  are  zero;  they  do  not  need  to  be 
explicitly  set. 

4.  Subroutine  FUNCON  will  be  called  before  subroutine  FUNOBJ.  The  parameter  NSTATE  is  used 
to  print  a  message  on  the  very  first  entry  to  FUNCON.  This  is  just  a  matter  of  good  pract  ice, 
since  it  is  often  convenient  to  compile  MINOS  and  the  function  routines  into  an  executable 
code  file,  and  one  can  easily  forget  which  particular  function  routines  were  used. 

5.  The  SPECS  file  shown  contains  keywords  that  should  in  general  be  specified  for  small,  dense 
problems  (i.e.,  ones  whose  default  values  would  not  be  ideal). 

6.  The  COLUMNS  section  of  the  MPS  file  contains  only  the  names  of  the  variables,  since  they 
are  all  “nonlinear”,  and  because  there  are  no  linear  constraints. 

7.  The  BOUNDS  section  specifies  only  the  initial  point.  Uniform  bounds  on  the  variables  are 
given  in  the  SPECS  file. 

8.  Since  PX  indicators  are  used  for  the  INITIAL  bounds,  the  SUPERBASICS  LIMIT  needs  to  be  at 
least  5  in  this  case,  plus  1  for  elbow  room  during  the  optimisation. 

9.  This  example  has  several  local  minima,  and  the  performance  of  MINOS  is  very  dependent  on 
the  initial  point  Zo.  Sec  Wright  (1976)  or  Murtagh  and  Saunders  (1982)  for  computational 
details. 
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PwMw  MHW4D;  (wapuMiM  «f  th»  okjicttM  ftmctloa 


SUBROUTINE  FUNOOJ1  MOOE.N.X.F  ,6,M8TATE, 
IMPLICIT  REAL*8( A-MtO-Z) 

DOUBLE  DECISION  X(N).6(N),Z(MC0RE) 


IP  (NPRQB  .NE.  41  80  TO  MO 
T(  ■  XII)  -  I.D 
Tfi  ■  XIII  -  X(E) 

T3  ■  Xtt)  -  XIS) 

T4  >XI»  -  XU) 

TS  >  X(4)  -  X(S> 


NPROB.Z.IDCORE  ) 


T4bb4  ♦  T3**4 


f  b  TIME  ♦  TfMf  ♦  T9MJ  ♦ 
8(1)  B  S.0*(T1  ♦  Tt) 

8(E)  >  -E.0BT8  ♦  3.0*T3**t 
80)  >  -3. #*T3**t  ♦  4,8*T4M3 
8(4)  ■  -4.8«T4MS  ♦  4.0BTSM] 
8(5)  ■  -4.0BT5MS 
RETURN 


588  T1  «  OSZN(X(S)  -  XO)) 

TS  >  OCOS(X(f )  -  XO)) 

F  >  18.0*X(  1  )*X(4)  ♦  xmw)  •  X(S>  -  A.RBX(t>B*t  •  XO) 
I  ♦  8.8*T1  ♦  X(t)MS  *  X(4)Mt  •  X(5)M4 

8(1)  a  18.8*X(4)  ♦  3.0BX(1)**t  •  X(Z) 

8(E)  *  X(  1  )MJ  -  1t.O*X(E)BXO) 

1  ♦  3.0*X(t)Mf  •  X(4)M(  •  X(5)M4 

8(3)  a  -4.8>X(S)M(  -  f.O»TZ 


8(4)  s  18.8*X(  1 ) 


6(3)  a 
RETURN 


■  4.8*Tf 


♦  8.8*X(t)M3  «  X(4)  •  X(5)M4 

4>8*X(t)M3  B  X(4)m|  •  XISIMS 


END  OP  FUNOBJ  FOR  HHMMHP8 
EM) 


uoo  u  u  uuu 


MHW4D)  — i M«Hw  ortho  ctwttftfr*  ftmctloM 


3UM0UT3HE  PUNCQNt  NOOt.H.H.lUAC.X.P  .t, NOTATE, MN)OS.Z,lt®a»f 
IMPLICIT  UtALatlA-M.O-Z) 

DOUBLE  HttCXSIOM  XINI.PUO.tllt.NI.ZUtCOtt) 


IF  INSTATE  .(«.  II  WZTElAi  UN)  NFWOt 
IF  (NPMB  .HE.  4)  tO  TO  Stt 
FID  a  XII)  ♦  XCtiaaf  ♦  XIS)MS 

t(t.t)  >  «.« 

Sll.t)  «  t.t»Xtt> 

til >3)  >  S.MXISIMt 

Fit)  ■  XI t)  -  XI3)**t  ♦  XIAI 

SIE.C)  >  |.o 

tit. 3)  >  •E.HXIS) 

tit. A)  a  l.o 


FIS)  «  XtOaXtS) 
tIS.I)  «  Xlt) 
0(3.3)  «  XII) 
RETUm 


Stt  Fit)  a  xiliwt  ♦  XIOMit  ♦  XlStaat  ♦  X(4)«*t  ♦  XlltMt 
tlt.l)  a  E.OaXIU 
tlt.t)  >  t.taXtt) 
til, SI  >  t.taXIS) 
til, A)  a  t.0*XIA) 
tlt.S)  >  t.OXtSI 
C 

Fit)  a  XIIIMWIISI  ♦  XIAHQIIS) 

tlt.l)  ■  t.0«Xlt  )AXI3) 

tlt.S)  ■  XltlMt 

tlt.AI  a  XISI 

tlt.S)  ■  XIA) 

C 

FIS)  >  Xlt)**t*XIA)  ♦  tt.HXmaXIS) 

tIS.I)  a  tO.Oaxif) 

tIS.t)  •  t.t*X(t>aX(4> 

tIS.A)  a  XltlMt 

tlS.S)  •  It. t»XI  I  ) 

MTUSN 

C 

tttt  FOBHATIF  SON  THIS  IS  PWtLtH  ItlMAANDt.  HPSOt  *.  IS) 

6  E)C  OF  FUNCON  FOR  IttNAIBt 
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BE6IN  MM  4 

PROBLEM  NUMBER 

4 

NONLINEAR  CONSTRAINTS 

S 

NONLINEAR  VARIABLES 

S 

JACOBIAN 

DENSE 

UPPER  BOtRB 

S.B 

LONER  BOUND 

-B.S 

SUftARY  PILE 

4 

ITERATIONS 

TBS 

MAJOR  ITERATIONS 

IS 

MINOR  ITERATIONS 

IS 

PENALTY  PARAMETER 

t  .4 

SUPERBASICS  LIMIT 

4 

PRINT  LEVEL  1JPUB) 

1ST 

VERIFY  LEVEL 

0 

NIMN« 
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e  coni 
e  cons 

C  CONS 

counts 


xi 

XI 

xs 

x% 

xs 


RMS 

CONI 

4.E4E4S 

RMS 

CONS 

0.BEB4E 

RMS 

mint 

CONS 

E.S 

PX  INITIAL 

XT 

-f.B 

PX  INITIAL 

XE 

E.S 

PX  INITIAL 

XS 

I.B 

PX  INITIAL 

X4 

•E.S 

PX  INITIAL 

XS 

•S.B 

OBATA 
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8.  Example ■ 


Problem  MANNE  (Manne,  1979) 

T 

maximiie  ^  /J,  log  C% 
t— 1 

subject  to  a,ff  J  >  Ct  +  /*,  1  <  I  <  T,  (nonlinear  constraints) 

if* 4.1  <  if*  +  /*,  1  <  I  <  r,  (linear  constraints) 

qKt  <  Ifi 

with  various  ranges  and  bounds. 

The  variables  here  are  Kt,Ct  and  /*,  representing  capital,  consumption  and  investment  during 
T  time  periods.  The  first  T  constraints  are  nonlinear  because  the  variables  if*  are  raised  to  the 
power  b  =  0.25.  The  problem  is  described  more  fully  in  Murtagh  and  Saunders  (1982),  where 
results  are  given  for  the  case  T  =  100. 

The  main  program  and  subroutines  shown  on  the  following  pages  are  part  of  the  file  HEAD1 
on  the  MINOS  distribution  tape  (see  sections  7.1  and  7.4).  The  SPECS  data  and  MPS  data  are 
contained  in  the  file  MANNE  DATA;  they  apply  to  the  case  T  =  10. 

Notes  for  problem  MANNE 

1.  For  efficiency,  the  Jacobian  variables  Kt  are  made  the  first  T  components  of  x,  followed  by 
the  objective  variables  C*.  Since  the  objective  docs  not  involve  Kt,  subroutine  FUNOBJ  must 
set  the  first  T  components  of  the  objective  gradient  to  icro.  The  parameter  N  will  have  the 
value  2T.  Verification  of  the  objective  gradients  may  as  well  start  at  variable  T  4- 1. 

2.  For  subroutine  FUNCON,  N  will  be  T.  The  Jacobian  matrix  is  particularly  simple  in  this 
example;  in  fact  J(x)  has  only  one  nonsero  element  per  column  (i.e.,  it  is  diagonal).  The 
parameter  NJAC  will  therefore  be  T  also.  It  is  used  only  to  dimension  the  array  G. 

3.  N STATE  enables  B,  AT  and  BT  to  be  initialised  on  the  first  entry  to  FUNCON,  for  subsequent  use 
in  both  of  the  function  subroutines.  (Remember  that  the  first  rail  to  FUNCON  occurs  before  the 
first  call  to  FUNOBJ.)  The  name  chosen  Tor  the  labeled  COMMON  block  holding  these  quantities 
must  be  different  from  the  other  COMMON  names  used  by  MINOS,  as  listed  in  section  7.3. 

4.  NSTATE  is  also  used  to  produce  some  output  on  the  final  call  to  FUNCON. 

5.  The  COMMON  block  MlFILE  is  one  of  those  used  by  MINOS;  see  section  i.fi.  For  test  purposes 
we  also  use  COMMON  block  M8DIFF  to  access  the  variable  LDERIV. 

6.  The  SPECS  file  uses  keywords  that  you  should  become  familiar  with  before  running  large 
problems.  Other  values  will  be  appropriate  for  other  applications. 

7.  The  MPS  file  specifies  a  sparse  T  X  T  Jacobian  in  the  top  left  corner  of  the  constraint  matrix. 
An  arbitrary  value  of  0.1  has  been  used  for  the  nonccro  variable  coefficients.  A  tcro  or  blank 
numeric  field  would  be  equally  good. 
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C  ms  IS  THE  DEFAULT  NAIM  PROSCAN  FOR  NINOS. 

C  IT  SHOULD  PROVIDE  AS  HUGH  MORK SPACE  AS  SEEMS  APPROPRIATE. 
C 

DOUBLE  PRECISION  Z!  10000) 

DATA  NMCORE/1 0000/ 

C 

CALL  HINOSIt  Z.tMCQRE  ) 

STOP 

C 

C  END  OF  MAIN 
END 


SUBROUTINE  FUNDBJ1  MODE .N.X.T ,G,N5T ATE, NPROB.Z.NMCORt  ) 
IMPLICIT  REAL*BIA-H.O-ZJ 

DOUBLE  PRECISION  XtN>.8tN)»Z(MC0RE> 

C  COmON  /NDOIFF/  DIFINTI E )  .GOUMMY , LDERIV, LVLDIF 

COmON  /MAMIE  /  B»AT1 100) >BTt  IDS) 

L06XCAL  GKNOM 

C  - - - — 

C  ms  IS  THE  DEFAULT  VERSION  OF  FtMDBJ  FOR  NINOS. 

C  IT  BELONGS  TO  THE  NONLINEAR  TEST  PROBLEM  MAMIE. 

C  MUCH  HILL  SPECIFY  PROBLEM  NUWER  till 

C  IN  OROER  TO  I0ENTIFT  ITSELF. 

C 

C  FOR  TEST  PURPOSES.  HE  LOOK  AT  DERIVATIVE  LEVEL 

C  AM)  SOMETIMES  PRETEND  THAT  NE  DONT  KNOU  THE  FIRST 

C  THREE  ELEICNTS  OF  THE  BRAD  I  ENT. 

C 

IF  (NPROB  .NE.  1111)  BO  TO  TOO 
ZERO  •  0.0 

GKNONN  *  LDERIV  .EC.  1  .OR.  LDERIV  .E9.  S 
NT  *  N/Z 

F  *  ZERO 

C 

DO  SO  J  ■  1,  NT 
XCON  *  XIMT*J) 

F  ■  F  ♦  BT(  J)*0L08(XC0N) 

SIJ)  ■  ZERO 

IF  (GKNONM  .OR.  J  .ST.  S)  0(NT*J)  >  BTIJI/XCON 
SO  CONTINUE 
RETURN 
C 
C 

C  IT  LOOKS  LIKE  SOME  OTHER  FUHOBJ  IS  NEEDED. 

C 

OSS  MTITE1IPRINT.  0000) 

IF  <  ISUrtl  .ST.  0)  NRXTEI ISUISI.  ODDS) 

MOOE  •  -1 
RETURN 
C 

OSSS  FORMAT!/  •  XXX  SUBROUTINE  FUHOBJ  HAS  NOT  SEEN  LOADED.*) 
C  EM)  OF  TUNOSJ  FOR  NAM« 


too 
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mnutm  ntcoNt  Moe.n.N.MjAc.x.r.e.MSTATe.Nreas.z.i 

zhsucit  rcal«m  a-m.o-zi 

dousu  fsccisioh  xiNt.rinifOdiMciiznaano 


comcn  /hi nut/  iMM.tmNT.titm 

cutsm  /mom/  oxFXNTizi.ooutn.Loexxv.ivuixF 

COMM  /MAMS  /  O.ATdOSI.BTIlOO) 

100ZCAL  MOM 


inis  zs  me  default  vorszat  or  fucon  rm  hinds. 

IT  MUMS  TO  me  NONLINEAR  TOT  rOQOLOl  HAIM. 
mzch  will  srecirt  fsooleh  mumoco  ittt 
zn  omn  to  zoorrzrT  zmir. 

reo  tot  ruirooes.  m  look  at  dcoivatzvc  Level 
and  aonennes  rorron  that  he  oont  knom  me  rzirsT 
meet  euneNTS  or  me  osaoxemt. 


zr  turn*  .ne.  tun  oo  to  too 

OKMONN  ■  ISfltZV  .M.  t 
NT  •  H 

zr  (nstatc  .m.  n  oo  to  too 

rZHST  DOST 

one  ■  i.o 

MOM  »  0.01 

OOTA  a  0.09 

wo  ■  s.o 

* CO  «  0.99 

XXO  •  0.09 

0  a  t.M 

MtXTEtZHIZMT.  10001  0 

A  a  (XC9  ♦  XZ9I  /  WOMI 

or  AC  a  (ONE  ♦  0MM)aa(0MC  -  01 

ATI 1 1  a  A*9FAC 

art  n  •  mta 

00  10  J  ■  t.  MT 

ATtJt  a  AT(  J-1  laOTAC 
OTIJ1  a  OTtJ-naOCTA 
10  C0KTXNUC 

OT(KT)  a  BTIMT )/( ONE  -  OCT  A) 

MOHHAL  tKTSY 

too  00  190  J  •  1.  MT 
WAT  a  XCJI 
FJ  a  ATIJI  •  WATMO 
FIJI  a  fj 

ZF  tOKtOM  .00.  J  .OT.  SI  0< 

too  cnmnn 

zr  (hit ati  .it.  ei  mum 

FINAL  CMTOT 


J  .OT.  SI  0(JI  ■  0*FJ  /  WAT 


MITtl XFOZMT,  C000I  IFIJI,  J  ■  1*  MTI 

serum 


n  looks  izxi  km  omeo  fucon  zs  Nceoco. 

900  MOZTfl IFSZMT.  90001 

zf  (zourot  .or.  01  wztcizoum.  ooooi 

HOOt  a  .1 

serum 

iooo  foshati //  •  mzs  is  mooicn  rwon.  o  •*.  re. si 

COSO  FOSHATI//  •  FINAL  MOMLINCAO  FUNCTION  VALUES*  /  (9F1t.SH 
9000  FOSHATI /  •  X»  SUOSOUTZNC  FUCON  HAS  NOT  MIN  LOAOCO.'I 
CND  or  FUCON  FOS  HAIM 

etc 
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too 

too 

too 

100.0 

PUN0BJ 


NONLINEAR  CONSTRAINTS  10 
NONLINEAR  JACOBIAN  VARS  10 
NONLINEAR  OBJECTIV  VARS  EO 

SUMMARY  TILE  0 

SUTV1ARY  FREQUENCY  I 

HEN  BASIS  FILE  II 

PROBLEM  NUMBER  till 

JACOBIAN  SPARSE 

MAJOR  ITERATIONS  8 

MINOR  ITERATIONS  EO 

PENALTY  PARAMETER  0.1 

HESSIAN  0IMEN3I0N  10 

DERIVATIVE  LEVEL  0 

VERIFY  GRADIENTS 

ITERATIONS  50 

PRINT  LEVEL  f  JFLWI  00101 

CYCLE  LIMIT  1 

CYCLE  PRINT  E 

END  MANNE 10 


BEGIN  HAM4E10 
MAXIMIZE 
RONS 
coLuets 
ELEMENTS 
UPPER  BOUM) 
OBJECTIVE  > 
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nmc  rutecia 

MM 

e  MONO  01 

e  nonoot 
e  honooj 
e  honoos 
e  honoos 
e  HONOoe 

e  HQN007 

e  honoos 
e  honoos 
e  mono 10 
l  CAPOOt 
L  CAP003 
L  CAPO 04 
L  CAP005 
L  CAPOOS 
L  CAP007 
L  CAPOOS 
L  CAPOOS 
L  CAPO 10 

l  temunv 

counts 


KAPOOt 

MONO 01 

.1 

CAPOOI 

1.0 

KAP001 

CAPOOt 

-1.0 

KAPOOt 

NONOOt 

.1 

CAPOOt 

1.0 

KAPOOt 

CAPOOS 

-1.0 

KAPOOS 

nonoos 

.1 

CAPOOS 

1.0 

KAPOOS 

CAPOOS 

-1.0 

KAP004 

NONOOS 

.1 

CAPOOS 

1.0 

KAP004 

CAPOOS 

-1.0 

KAPOOS 

NONOOS 

.1 

CAPOOS 

1.0 

KAPOOS 

CAPOOS 

-1.0 

KAP004 

HONOOS 

.1 

CAPOOS 

1.0 

KAP004 

CAP007 

•1.0 

KAP007 

H0N007 

.1 

CAPOOT 

1.0 

KAPOOT 

CAPOOS 

-1.0 

kapoos 

NONOOS 

.1 

CAPOOS 

1.0 

KAPOOS 

CAPOOS 

-1.0 

KAPOOS 

NONOOS 

.1 

CAPOOS 

1.0 

KAPOOS 

CAP0 10 

-1.0 

KAP010 

H0N010 

.1 

CAP010 

1.0 

KAP010 

TUWINV 

.OS 

CONOOI 

NONOOt 

-1.0 

CONOOt 

NONOOt 

-1.0 

CONOOS 

HONOOS 

-1.0 

COHO 04 

HONOOS 

-1.0 

CONOOS 

NONOOS 

-1.0 

CONOOS 

HONOOS 

•1.0 

C0N007 

H0N007 

•1.0 

CONOOS 

HONOOS 

-1.0 

CONOOS 

HONOOS 

-1.0 

CONOIO 

HONOIO 

-1.0 

INVOOI 

N0N001 

-1.0 

CAPOOt 

-1.0 

INVOOt 

NONOOt 

-1.0 

CAPOOS 

-1.0 

INVOOS 

HONOOS 

-1.0 

CAPOOS 

-1.0 

INV004 

HONOOS 

•1.0 

CAPOOS 

-1.0 

INVOOS 

HONOOS 

•1.0 

CAPOOS 

-1.0 

INVOOS 

HONOOS 

-1.0 

CAP007 

•1.0 

INV007 

NONOOT 

-1.0 

CAPOOS 

•1.0 

INVOOS 

HONOOS 

-1.0 

CAPOOS 

-1.0 

INVOOS 

HONOOS 

-1.0 

CAP010 

-1.0 

INV010 

HONOIO 

-1.0 

CAP011 

•1.0 

INV010 

TEMUNV 

-1.0 

I 

I 

3 


I 


8.4  Noallawlj  Coaatniaed  Optimisation 


MS 


Problem  MANNEj  tha  MRS  Ibe,  continued 


HNS 

•  THE  RMS  IS  ZERO 


RANKS 


RANK! 

IK)N0!0 

10.0 

BOUNDS 

rx  bourn 

KAROO! 

3. OS 

LO  BOUWM 

KAROOS 

3.  OS 

tO  BOUND! 

KAROOS 

S.OS 

LO  BOURN 

KAPOOR 

S.OS 

LO  BOUND! 

KAROOS 

S.OS 

LO  BOUND! 

KAPOOR 

S.OS 

LO  BOUKJ! 

KAP007 

S.OS 

LO  BOUND! 

KAROOS 

S.OS 

LO  BOUND! 

KAPOOR 

S.OS 

LO  BOURN 

KAR0 10 

S.OS 

LO  BOUND! 

CONOO! 

.ss 

LO  BOUND! 

CONDOS 

,ss 

LO  BOUND! 

CONDOS 

.ss 

LO  BOUND! 

COMOO* 

.ss 

LO  BOUND! 

CONOOS 

.ss 

LO  BOURN 

CONDOR 

.ss 

LO  BOURN 

C0N007 

.ss 

LO  BOUND! 

CONDOS 

.ss 

LO  BOUR!! 

CONOOS 

.ss 

LO  BOURN 

CONOID 

.ss 

LO  BOUR)! 

INVOOI 

.03 

LO  BOURN 

INVOOS 

.OS 

LO  BOURN 

INVOOS 

.OS 

LO  BOUND! 

INTO  OR 

.OS 

LO  BOUR)! 

INVOOS 

.03 

LO  BOURN 

INVOOR 

.03 

LO  BOUND! 

INV007 

.OS 

LO  BOUR)! 

INVOOS 

.OS 

LO  BOUND! 

INVOOS 

.OS 

LO  BOUR)! 

INTO  10 

.03 

UR  BOUND! 

INVOOS 

.lit 

UR  BOUR)! 

INVOOS 

.HR 

UR  BOUND! 

INV0!0 

.HR 

RX  INITIAL 

KAROOS 

3.1 

PX  INITIAL 

KAROOS 

s.t 

PX  INITIAL 

KAPOOR 

s.s 

PX  INITIAL 

KAROOS 

S.R 

PX  INITIAL 

KAPOOR 

s.s 

PX  INITIAL 

KAR007 

S.R 

PX  INITIAL 

KARON 

S.7 

PX  INITIAL 

KARMS 

S.S 

PX  INITIAL 

KARRIS 

s.s 

EM)ATA 


8.4  Nonliawly  Constrained  Optimisation 


Problem  MANNE;  output  from  MINOS,  continued 


mbs  nut 

i  mm  mm Bit 

t  tout 

CS  COLUMO 

xsoor  marnjnr  -  m  i wear  outer rw  sc  urm 

root*  NON-cxitnifr  bon  mcihh  —  cabrri  —  entit  zoom  w  tot  w 
looot  bon  sbicifico  —  cinn  —  omit  t»mi  in  uni  *1 

41  RMS 
44  • 

47  •  INC  MS  *»  ON 

44  • 

4V  NMCI 

woe  nabnino  -  ini  mm  n  am 

71  Bourn 
114  MATA 

MOOT  TOTAL  NO.  Of  BWW  IN  NfS  FXU  I 


NANIS  W  If  CTO 


outer  tvt  njNou  noun 

RNS  INS 

RANKS  RANK1 

m§f  0QUND1 


• 

R 

I 

n 


MATRIX  STATISTICS 


TOTAL  NORMAL 
RONS  IS  10 
COUfRQ  M  t 


FOCI  fXXtS  MM  BIO 

•  •  t 

S  1  19 


NO.  Of  NAT*  IX  ELEMENTS  St  DENSITY  t.SSS 

NO.  Of  REJECTED  COCPFS  R  AIJTOL  1.000040*10 

0I0KST  AMI  SMALLEST  COIPPS  1.499990 *94  1.440990*91  IDCUBMO  0U  AMI  RNS  I 


l fNRTH  Of  RON* MAW  MAIN  TABLE  It  I 

COLLISIONS  QUOINS  TABU  lOORU*  9 

NO.  OP  JACOBIAN  ENTRIES  SPECIFIED  10 


NO.  OP  INITIAL  ROMS  PROCESSOR  9 

NO.  OP  SUftROASICS  SPEC  I  MED  9 

NONKROS  A  HOMED  fmWW  FACTORS  14999 


INITIAL  BASIS 


THIS  IS  PROBLEM  NAIM.  0  •  9.IS9 


T  OUT  Of  10  CONSTRAINT  RR  AO  UMTS. 


CRARM  OPTION  1 
FREE  ROMO  9 


9  BASSO  II  ROMS  I  4  BASBS  t4  4fW>|iBt9 


XTIBATIONR 


START  Of  MAJOR  ITM 


•fHALTT  PMIIMTER  •  1.990-41 


MAXIMUM  CONSTRAINT  VIO’ 

FACTOR I Zt  1  RE  - 

NONLINEAR  19  IT 

compress**  4  m 

LHAX  9.9  SNAX 

ITM  4  —  INPIASIOLI. 


4  <  •  4.4 

'RATION  4  XNPIAS 

:RS  9  ELIM9 

9  UNU 
<  4.9  UNIN 

jn  •  I. 9999999990-4 S 


MBttUmi 

1  OBJECT  I  VC  4.9 

09  OEMfITf  7  49 

S9  1NCREAM  9.4 

1. 40*99  9R0MTM  9.4 


ITM  PM  PP  MOOT  DJ.99  *499  -SOS  -OS  STEP  PIVOT  L 

1  4  I  9  9.4  4  19  19  1.10*99  -S.«9-4t  9 


U  NCR  NINP  SINP.MjtCTTVt 

S9  9  1  1 .999999990-91 


***  TVIMOB)  SETS  \J  OUT  OP  19  CBJttTlVf  ORMItNTO. 


ITM  1  ..  PEAStSU  SUO PROBLEM.  TRUE  OU  •  1.4449997(90*99 


t 


Problem  MANNE;  MApA  hmm  MINOS,  continued 


WtJI  111 

I.WW 
(.•(Ml 
t.oi  m 
I.MW 
t.lIMt 
!.«»« 
l.tlMt 


«  MnWHHI  •.«TNMM 

•  MWWIW  II  •.♦TIWIMI 

I  MIWIII  W  l.tmiMM 

7  l.«NHniMI  I.MMMM 

•  MNHMHI  I.Mtlttn 

«  i.mum  w  i.iimmiu 

«•  >.mnww  m  i.mnm 

«•  MW  i»  m  m. 

M  MM  «.  eiUMt  * 


Mnncnwir 


I.MNMmilMI  tWMMIMI  H 
I.MIMMMM1  MWHHW  H 


I.MWMIWI  l.MM  «■ 
I.MimTWM  I.IIHI 
I.NII4MWM  I.Ma-M 
I.IM1MMWM  IIM-M 
I.IMHIM'M  IMI-N 
i.imnnhM  i.tiMi 
I.IIMMMI  I.IM-M 


1M  UMM  MUTTM  I 
IUM  MMT  «•  I. 


7  .MMMMI 
7.MIIIIIM  H 

t.ntMMiMi 
I.MIIIWMI 
1.71  TIM  1 11-11 
•.IMIMMHt 
MMMMWI 


T.MIMWn 

T.IWMn-ll 

I.HIWMMI 

l.tHlTMM-ll 

I.TtTMtMM-ll 

•.•MWMMI 


M  MM  UMM. 
MHWM  M 


till  t.M-M  III  I.MMI  l.l 
MMW7M*  IWUMl  Ml  MW  M  •  I.MW 


II  I  •  I.MMIINMI 
MM  It  ■  T.tM'M 

nrru  nw  •  i 


II  III  l.»'H  TTT, 


VI  "I “"V  ■  ■ 

•  (.toNM* 

mNNHinst 

ktwuw  mum 

I.MI7MHI  I.MIHM  II  MWIMMI 
t.MMHMt  >.MI—  II  I.MM1M-M 

*  awMwtt^i 

V 

I.IMlHIMI 

7.IMH7H-M 

■  MM  MW*  MfW 
1  *  I  -•  l.«Mt 
•  •  I  .«  I.M-M 


Si* 


8.5  Ute  ot  Subroutine  MATMQO 


t.S  Us*  of  Subroutine  MATMQO 

The  following  example  illustrates  the  construction  of  a  sequence  of  problems,  based  on  the  Diet 
problem  of  section  8.1.  It  assumes  that  the  following  cards  have  been  added  to  the  SPECS  file: 

CYCLE  LIMIT  3 

CYCLE  PRINT  3 

CYCLE  TOLERANCE  2.0 

PHANTOM  COLUMNS  1  (or  aoro) 

PHANTOM  ELEMENTS  3  (or  aoro) 

1.  Solution  of  the  original  problem  constitutes  cycle  1. 

2.  After  cycle  1,  MATMOD  will  be  called  twice  with  NCYCLE  =  2  and  3  respectively,  denoting  the 
beginning  of  cycles  2  and  3.  The  value  of  N  will  include  the  normal  columns  and  the  phantom 
columns;  in  this  case,  N  =  6  +  1  =  7.  Likewise,  NE  includes  normal  and  phantom  elements; 
in  this  case,  ME  =  24  +  3  =  27. 

3.  For  cycle  2,  we  alter  the  cost  coefficient  on  the  variable  called  CHICKEN.  This  happens  to  be 
the  second  variable,  but  for  illustrative  purposes  we  use  the  MINOS  subroutine  M3MAME  to 
search  the  list  of  column  names  to  find  the  appropriate  index.  In  this  case,  M3NAME  will  return 
the  value  JCHICX  —  2. 

4.  Similarly,  we  use  M3NAME  to  search  the  list  of  row  names  to  find  the  index  for  the  objective 
row,  whose  name  is  known  to  be  COST.  In  this  case,  M3NAME  will  return  the  value  JCOST  = 
11.  Since  rows  are  stored  after  the  N  columns,  this  means  that  the  objective  is  row  number 
JCOST  —  N  —  4.  (As  it  happens,  this  value  is  already  available  in  the  COMMON  variable  IOBJ.) 

5.  This  example  assumes  that  CHICKEN  already  had  a  noniero  cost  coefficient,  since  it  is  not 
possible  to  increase  the  number  of  entries  in  existing  columns.  If  the  cost  coefficient  was 
previously  tero,  it  would  have  to  be  entered  as  such  in  the  MPS  file,  and  the  SPECS  file 
would  have  to  set  AIJ  TOLERANCE  *  0.0  to  prevent  scro  coefficients  from  being  rejected. 

6.  For  cycle  3,  we  generate  one  new  column  by  calling  upon  the  MINOS  subroutine  MATCOL. 
The  PHANTOM  COLUMNS  and  PHANTOM  ELEMENTS  keywords  must  define  sufficient  storage  for 
this  new  column.  (The  estimates  defined  by  the  normal  COLUMNS  and  ELEMENTS  keywords 
must  also  allow  for  the  phantom  columns  and  elements.) 

7.  For  illustrative  purposes,  we  make  use  of  the  specified  CYCLE  TOLERANCE  and  the  value  of 
X(l)  in  the  current  solution,  to  decide  whether  to  proceed  with  cycle  3. 

8.  After  the  call  to  MATCOL,  the  COMMON  variable  JNEV  points  to  the  new  column.  It  allows  us  to 
set  a  finite  upper  bound  on  the  associated  variable,  if  there  had  been  insufficient  storage,  or 
if  C0L(*>  contained  no  significant  elements,  MATERR  would  have  been  increased  from  0  to  l. 
Usually,  this  means  that  the  sequence  of  cycles  should  be  terminated  (by  setting  FINISH  = 
.TRW.). 


non  non 


8.  Examples 


C 


SUBROUTINE  NATMODI 

* 


NCYCLC.  NPROB,  FINISH. 

H.  N.  IB.  HE.  MU,  MS.  NSCL, 
A,  HA,  KA,  Bl,  BU, 

ASCALE.  HB.  101,  IDE. 

X,  PI,  Z.  MCQRE  I 


IMPLICIT 

XMTEBEINS 

XNTECER 

DOUBLE  PMCXSXflM 
DOUBLE  PRECISION 
LOS  I  CAL 


REAL«8(  A-H.O-Z) 

MAINE),  MS  I  Ml) 

KAINKA),  XDt(tB),  I0ZINB) 

A1NE  >,  ABCALEINSCL).  BLUB  I,  BIN  MB) 
XOB),  PSINI,  ZIMCQBE > 

FINISH 


MINOB  CflmON  BLOCKS  (TO  BE  USED  BUT  MOT  ALTERED). 


COMMON  /Ml FILE/  XREAD.XPRXMT.XSUHH 

COUCH  /MSLOBJ/  SINF .MTOBJ.HINIHZ.NINF .IOBJ 

COMMON  /CYCLCH/  CWTOL.  JNEN,  HATE**.  HAXCY.  HE  WRIT,  NPHAMT.NPRINT 

LOCAL  STORABE. 

OOUBLE  PRECISION  COL(lt).  ZTOL 

INTEBER  CHICK) ,  CMICXt.  C0ST1 ,  COSTS 

OATA  CHICK),  CHICKS  /'CHIC*,  'KEN  '/ 

t*TA  COST  I .  COSTS  /'COST',  '  '/ 

C  THIS  IS  AM  EXAMPLE  OF  A  USER -WITTEN  SUBROUTINE  NATMOD, 

C  MUCH  DEFINES  A  SEQUENCE  OF  PROBLEMS  BY  PERFORM  IMS  INTERNAL 
C  MODIFICATIONS  TO  THE  OATA  FOR  THE  DIET  PROBLEM. 

C 

C  NATMOD  IS  CALLED  AT  THE  BESXMtXNB  OF  EACH  CYCLE  EXCEPT  THE  FIRST. 

C  NCYCLE  HILL  TAKE  THE  VALUES  S,  J,  ...  UP  TO  THE  CYCLE  LIMIT. 

C 

C 

IF  (NCYCLE  .ST.  SI  BO  TO  SOS 
C 


CYCLE  S.  ALTER  THE  COST  ON  CHICKEN. 


C 

C  USE  THE  MINOS  SUBROUTINE  N3NAME  TO  FIND  THE  COLUM  INDEX 

C  FOR  THE  VARIABLE  NAMED  CHICKEN.  COLUMN  NAMES  ARE  CONTAINED 

C  IN  THE  FIRST  N  LOCATIONS  OF  101  AM)  IDS. 

C 

C  CERTAIN  QUANTITIES  MUST  BE  INITIALIZED  BEFORE  THE  CALL. 

C  THE  FIRST  THREE  SUPPRESS  ERROR  MESSA6ES.  THE  NEXT  THREE 
C  DEFINE  THE  RANBE  OF  NAMES  TO  BE  SEARCHED  AND  MtERC  TO  START. 
C 

NCARO  a  S 


Jl  a  ) 

Jt  ■  N 
JMARK  ■  Jl 

CALL  HSNAMBI  «.  10).  IDE.  CHICK! ,  CHICKS. 

•  NCARO.  MOTFM).  HAMfSS,  Jt ,  Jt,  JMARK,  JCMICK  I 

IF  ( JCMXCX  ,EQ.  «)  80  TO  POD 
C 


8.5  Uee  of  Subroutine  MATMOD 


e  non  fim  me  noex  of  the  objective  rom,  imicn  is  named  cost. 

C  MM  NAMn  AM  STORED  IN  THE  LAST  H  LOCATIONS  OF  XDI  AM)  IOC. 

C 

Jl  •  N  ♦  I 

jc  ■  m 

JHARK  >  Jt 

CALL  H3NAHCI  M.  101,  ZOS,  COSTt,  COSTS, 

•  NCARD,  NOTnC.  NAMOS.  Jl,  JE,  JNARK,  JCOST  ) 

IF  (JCOST  .ED.  01  DO  TO  MS 
C 

C  THE  RON  MOVER  IS  MM  JCOST  -  N.  IN  FACT,  THIS  VALUE  COULD  NAVE 
C  MEN  OBTAINED  DIRECTLY  FROM  THE  COMON  VARIABLE  I  OBJ. 

C 

ICOST  ■  JCOST  -  N 
IF  (SCOOT  .HE.  IOBJI  DO  TO  SOS 
C 

C  MM  HE  OSF  INTO  THE  MATRIX  DATA  STHUCTUM  TO  FIND  (MERE  THE 
C  COST  COEFFICIENT  IS  IN  THE  MATRIX  COUtM  ASSOCIATED  HTTN  CHICKEN. 
C 

K1  a  KA( JCNSCKI 

KE  a  KAIJCMICX  ♦11-1 

00  ECS  K  a  K1,  KE 

IF  (HA(KI  .19.  ICOST)  SO  TO  ESS 
CEO  CONTINUE 
SO  TO  SOS 
C 

C  ME  POUM  IT.  MM  SUPPOSE  CHICKEN  IS  MUMS  AT  A  BAHRAIN  RATS. 
C 

ISO  OUK  a  A(Ki 
AIK)  a  tS.O 

IF  (HUM  .ST.  SI  MXTEIXSUM.  CSSS)  OUK.  A(K) 

RETURN 

C 

c  - — - - - - — - - - — - — 

C  CYCLE  S.  SEMERATC  A  NEW  COLWM. 

C 

C  FOR  ILLUSTRATIVE  PURPOSES  HE  SET  l)R  THE  HEN  PROBLEM  ONLY  IF 
C  THE  SOLUTION  TO  THE  CUM  ENT  PROBLEM  CONTAINS  MOM  OATMEAL  THAN 

C  THE  SPECIFIED  CYCLE  TOLERANCE.  HE  HAPPEN  TO  (OEM  THAT  OATMEAL 

C  IS  THE  FIRST  VARIABLE.  XII). 

MS  IF  (NCTCll  .ST.  SI  00  TO  SSS 

IF  (ISUfl  .ST.  S)  WITCCZSUMf.  MSS)  X(t> 

IF  1X11)  .IE.  CMfTOL)  SO  TO  SSS 

COLD)  a  SSS.S 

COLIC)  a  CS.S 

COLO)  a  S.S 

COLO)  ■  B.S 

ETUI  a  1  .SC -A 

CALL  NATCOU  N.  N,  M,  HE,  MU. 

R  A,  NA,  KA,  OL.  OU.  COL.  ZTOL  ) 

0  . _ 

C  THE  CONOM  VARIABLE  NATEM  IS  9UTTALXZI0  EARLIER  TO  EERO. 

C  NATCOL  MILL  DCRCMENT  IT  IN  THE  EVENT  OF  ERRORS. 

C  NATCOL  ALSO  IICREUENTE  JNBN  TO  POINT  TO  TNC  MEN  COUSM. 

C  M  USE  JNON  TO  OWE  THE  ASSOCUTEO  VARIABLE  AN  UPPER  ROUND. 

e 

IF  (NATEM  .OT.  SI  00  TO  SM 
OMJNM)  •  C.S 

C 

C  - - - - — ........ - - 

C  TMNENATC  CTCLES  (MNR  VARIOUS  COMZTIflNO. 

C  . — - 


112  8.  Examples 

1.1  Thins*  to  RtnMmbtr 

Use  the  following  space  to  record  the  fruits  of  your  experience.  They  may  be  useful  reminders 
the  next  time  you  come  to  run  MINOS.  (We  suggest  you  use  a  pencil.) 
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A,  in  printed  solution,  70,  72 

Accuracy,  for  satisfying  linear  constraints,  26,  67 
for  satisfying  nonlinear  constraints,  36 
for  solving  linearised  subproblems,  22 
of  computed  functions,  27,  66-67 
of  linesearch  procedure,  28-22 
AIJ  TOLERANCE,  21 
Alternative  optimum,  70 
Augmented  Lagrangian,  3-4,  59 

B,  Basis  matrix,  2-3,  34 
BACKUP  BASIS  FILE,  21,  49-51 
Bartels,  R.  H.,  ii,  2 

Basic  variables,  2 
BASIS  files,  49-56 
Basis  map,  49-51,  68-69 
Basis  matrix,  B,  2-3,  34 
Bounds,  1-5,  46—48 
specification  of  default  values,  29,  38 
BUAX,  in  basis  factorisation  statistics,  62 
BOUNDS  section  of  MPS  file,  46-48 
BOUNDS  keyword,  specifying  name  of  bound  set,  21 
~BS,  in  iteration  log,  58 

CALCFG,  subroutine,  i 
CALCON,  subroutine,  I 
CENTRAL  DIFFERENCE  INTERVAL,  22 
CHECK  FREQUENCY,  22 
COEFFICIENTS,  22 
Cold  start,  see  CRASH  procedure 
Column  ordering,  implicit,  31,  44 
Column  variables,  1,  71 
COLUMNS  section,  of  MPS  file,  31,  43-44 
of  printed  solution,  71-72 
COLUMNS,  estimate  of  number  of  variables,  22 
Comment  cards,  in  MPS  file,  41-48 
in  SPECS  file,  17-18 
COMMON  blocks,  7,  15-16,  63,  78,  79 
reserved,  78 

Compatibility  with  MINOS  4.0,  51 
COMPLETION  options,  22 
Composite  objective  technique,  40 
COMPRSSNS,  in  basis  factorisation  statistics,  61 
Conjugate-gradient  method,  i 
Constant  Jacobian  elements,  12,  44 
CONV,  in  iteration  log,  60 
Convergence,  likelihood  of,  4,  23-24,  30 
rate  of,  3,  27,  34 

tolerances,  see  FEASIBILITY  TOLERANCE, 
OPTIMALITY  TOLERANCE  and 
ROW  TOLERANCE; 
also  see  CYCLE  TOLERANCE 
CRASH  procedure,  for  selecting  initial  baste, 

22-23,  47 

CRASH  options,  22-23,  47 

Cycle  facilities  (for  sequences  of  problems),  8, 

13-15,  23,  56,  109-111 
CYCLE  options,  see  cycle  facilities 
Cycling  (endless  iterations),  65 


D,  in  printed  solution,  70,  72 
Damped  Newton  method,  23 
DAMPING  PARAMETER,  23-24 
Dantsig,  G.  B.,  i,  ii,  1 
Data,  input  sequence,  7 
Davidon,  W.  C.,  i,  2 
DEBUG  LEVEL,  24 

Default  values  for  SPECS  file  keywords,  18-20 
Degenerate  variable,  70 
DEMAND,  in  basis  factorisation  statistics,  61 
Dense  Jacobian  matrix,  44,  94,  96 
DENSITY,  in  basis  factorisation  statistics,  61 
DERIVATIVE  LEVEL,  9-12,  24-25 
DIFFERENCE  INTERVAL,  25 

Difference  approximation  to  derivatives, 
see  missing  gradients 
DJ,  in  iteration  log,  58,  60 
Dual  simplex  method,  i 
Dual  variables,  10,  32,  64,  70,  71,  72 
DUMP  file,  25,  53-54 

ELEMENTS,  estimate  of  nonseros  in  A,  25 
ELEMS,  in  basis  factorisation  statistics,  61 
EMERGENCY  VERIFY  LEVEL,  see  VERIFY  options 
End-of-File  condition  when  reading  SPECS  file, 

63,  81 

ENDRUN  message,  63 

Equality  constraints,  42 

Error  checks,  on  computed  gradients,  36-37, 

38-39,  66 

on  satisfying  Ax  +  a  =•  0,  22,  67 
Error  messages,  34,  63-69 
during  input  of  MPS  file,  26 
ETAMACRO,  test  problem,  75,  84,  92 
Example  problems,  85-108 
Exit  conditions,  63-69 

F,  parameter  of  FUN0BJ,  10,  16 
F(*),  parameter  of  FUNC0N,  11,  12 
F(x),  see  nonlinear  objective  function 
/(z),  see  nonlinear  constraint  functions 
Factorisation  of  basis  matrix,  26,  29,  S3,  58-59, 

61-62 

FACTORIZATION  FREQUENCY,  26 
FACTORIZE,  in  basis  factorisation  statistics,  61 
FEASIBILITY  TOLERANCE,  26,  47,  64 
Feasible  points,  definition,  3 
evaluation  of  functions  at,  3,  26,  47 
Files,  6  7,  80,  82,  85 
Formulation  of  problems,  5,  6 
Fortran  source  files  for  MINOS,  75-81 
Fortran  66  versus  Fortran  77,  76 
Free  rows,  42 
Free  variables,  46 

Full  completion  (accurate  solution  of  subproblems), 
22 

FUNC0N,  subroutine,  7,  8 
consistency  with  MPS  file,  44 
examples,  96,  100 
specification,  11-12 
FUNCTION  PRECISION,  27,  67 
FUNOBJ,  subroutine,  7,  8 
consistency  with  MPS  file,  44 
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example*,  90,  96,  99 
•pacification,  9-10 


G(*) ,  parameter  of  FUMOBJ,  10 
G(*),  parameter  of  FUNCON,  11-19,  44 
GUI,  P.  E.,  U,  9,  3 
Global  optimum,  6,  64 
Golub,  G.  H.,  U,  9 

GROWTH,  in  baeia  factorisation  statistics,  69 


Header  cards  in  MPS  file,  41 
HESSIAN  DIMENSION,  97,  37 
Hessian  matrix,  3 
HMOD,  in  iteration  log,  59 
H-CONDN,  in  iteration  log,  60 
HS(*) ,  state  vector,  14,  50-61,  69 


I,  in  printed  solution,  71,  79 
INCREASE,  in  basis  factorisation  statistics,  69 
Inequality  constraints,  43 
INFEAS,  in  basis  factorisation  statistics,  61 
Infeasibilities,  26,  40 
Infeasible  problems,  26,  64-68 
Infeasible  subproblems,  64-65 
Infinite  bounds,  46 
Initial  point,  s0,  3,  4,  5,  23,  47-46 
INITIAL  bounds  set  in  MPS  file,  47-46 
Input  to  MINOS,  7 
examples  of,  85-103 
INSERT  file,  27,  52-53,  54 
Installing  MINOS,  75-81,  96 
Integer  programming,  I 

Internal  modifications  to  problem,  see  cycle  faculties 
Invert  procedure,  see  factorisation  of  basis  matrix 
Iteration  log,  29,  57-60 
example,  105-106 
ITERATIONS  LIMIT,  26 
ITN,  in  iteration  log,  67  ' 


Jacobian  matrix,  J(s),  definition,  9 
computation  of,  11-19 
constant  coefficients,  12,  44 
position  within  constraint  matrix  A,  4,  44 
printing,  34 

minitv  nitlirn  IS,  44 

JACOBIAN  option  (DENSE  or  SPARSE),  96,  44 


Keywords  in  SPEC8  file,  17 
checklist  and  default  values,  16-90 
definitions,  31-40 
Kreuser,  J.,  I 


1}  problem,  93 
X,,  see  Lagrange  multipliers 
L,  in  iteration  log,  58 
LAOS  basis- handling  package,  U 
Lagrange  multipliers,  X*,  i,  4,  13,  14,  71 
printing,  34 
initial  estimate,  Xo,  4 
Lagrangian,  4 

LAGRANGIAN  option  (YES  or  NO),  4,  28 
Least  squares,  linear,  92-93 
LENL,  in  basis  factorisation  statistics,  61 
LENU,  in  basis  factorisation  statistics,  61 
LINEAR,  in  basis  factorisation  statistics,  61 
Linear  approximation  to  nonlinear  constraints, 
see  linearised  constraints 
Linear  constraints,  1-5,  15 
Linear  programming,  1,  9 
example,  86-87 

test  problem,  see  ETAMACRO 
Linearised  constraints,  4,  70 
Linearly  constrained  optimisation,  3-3 
examples,  90-93 
Line  search,  3 
accuracy  of,  29 
failure  of,  68-67 
LINESEARCH  DEBUG,  28 
LINESEARCH  TOLERANCE,  26-29 
Linesearch  procedures,  ii,  28-29,  38 
Linking  subroutines  to  MINOS,  88 
LIST  LIMIT,  for  printing  MPS  file,  29 
LMAX,  in  basis  factorisation  statistics,  69 
LOAD  file,  29,  53-54 
LOG  FREQUENCY,  29,  34 
Local  optimum,  5,  64 
Logical  variables  (slacks),  1 
Lower  bounds,  see  bounds 

LOWER  BOUND  (default  lower  bound  on  all  variables), 
29 

It 1  factorisation  of  basis  matrix,  i— ii,  2,  3,  61,  68 
see  factorisation  of  bast-  matrix 
LU  FACTOR  TOLERANCE,  30,  62 
LU  UPDATE  TOLERANCE,  30 
LUSOL  basis-handling  package,  i— ii,  2 

m»mi  +  ms  (number  of  nonlinear  and  linear 
constraints),  1,  6 

mi  (number  of  nonlinear  constraints),  1,  6,  16 

my  (number  of  linear  constraints),  1,  6,  16 

Machine-dependent  subroutines,  75,  79-81 

Machine  precision,  «,  18,  81 

Main  program,  79,  69 

Mgjor  iteration,  4 

MAJOR  ITERATIONS  limit,  30 

Manne,  A.  S.,  ii,  83,  64 

MANNE,  test  problem,  75,  76,  80,  83,  96-106 

Markowits,  ordering  for  sparse  LU  factorisation, 

ii,  2,  61 

MATC0L,  subroutine,  14,  23 
specification,  15 

Mathematical  programming  systems,  i,  34,  41,  46, 
52-54 

MATM0D,  subroutine,  7,  8,  93,  89 
example,  109-111 
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specification,  15-14 

Matrix  coefficient*,  ignoring  small  values,  21,  102 
number  of,  25 
Matrix  data  structure,  15 
Minor  iteration,  2 
MINOR  ITERATIONS  limit,  20 
MINOS,  acronym,  ii 

MERIT,  in  basis  factorisation  statistics,  51 
MHW4D,  example  problem,  54-57 
Missing  gradients,  1,  5,  24-25 
MODE,  parameter  of  FUNOBJ  and  FUNCON,  5-10, 11, 
12,  65 

MPS  file,  6,  7,  20,  41-45,  55 
examples,  57,  55,  51,  57,  102-105 
restrictions  and  extensions,  45 
MULTIPLE  PRICE  option,  31 
Murray,  W.,  H,  2,  3 
Murtagh,  B.  A.,  2,  3 


s*ni+si  (number  of  nonlinear  and  linear 
variables,  excluding  slacks),  1,  6 
ni  ”  max{n'i,fi"}  (number  of  nonlinear  variables,  s), 

1,  5,  16,  37 

(number  of  nonlinear  objective  variables),  31 
n”  (number  of  nonlinear  Jacobian  variables),  31 
n*  (number  of  linear  variables,  y),  1 
N,  matrix  associated  with  nonbasic  variables,  2 
N,  in  printed  solution,  71,  73 
NAME  card  in  MPS  file,  41 
NCON,  in  iteration  log,  55 
NCP,  in  iteration  log,  55 
NIMF,  in  iteration  log,  55 
NJAC,  parameter  of  FUNCON,  11,  12,  16 
NEW  BASIS  file,  21,  31,  45-51 
NOBJ,  in  iteration  log,  55 
Noisy  functions,  i,  27,  56-57 
Nonbasic  variables,  2 

Nonlinear  constraint  functions,  /(f),  1,  3-4,  7,  11-12 
printing,  34 

Nonlinear  constraints,  1,  3-4,  5 
Nonlinear  equations,  23-24 
Nonlinear  Jacobian  variables,  31,  44 
Nonlinear  objective  function,  f(f),  1,  2-3,  7,  5-10 
Nonlinear  objective  variables,  31,  44 
Nonlinear  variables,  1,  4,  44 
printing,  34 

NONLINEAR,  in  basis  factorisation  statistics,  61 
NONLINEAR  CONSTRAINTS  and  VARIABLES,  31 
Nonlinearly  constrained  optimisation,  3-4 
examples,  94-105 
N0PT,  in  iteration  log,  55 

NPR0B,  parameter  of  FUNOBJ,  FUNCON  and  MATM0D, 
10 

NSB,  in  iteration  log,  55 

N STATE,  parameter  of  FUNOBJ  and  FUNCON,  10 
NNC0RE,  parameter  of  FUNOBJ,  FUNCON  and  MATM0D, 
10,  40,  75 


Objective  function  (f(x)  4-  eTx  4-  d*V),  1 
Objective  row  in  MPS  file  (defining  e*x  4-  «f*V),  43 
OBJECTIVE,  in  basis  factorisation  statistics,  61 
OBJECTIVE,  in  iteration  log,  55 
OBJECTIVE  keyword,  specifying  name  of  Hnsar 
objective,  32 

OLD  BASIS  file,  21,  32,  45-51 
Optimal  solutions,  local  and  global,  5,  63-64 
OPTIMALITY  TOLERANCE,  32,  64,  67,  71 
Ordering  of  constraints  and  variables,  31,  42,  44 
Output  from  MINOS,  57-74, 

see  also  LOG  FREQUENCY,  PRINT  LEVEL, 
SUMMARY  FREQUENCY 

P*  ordering  for  sparse  W  factorisation,  I 

Parameters,  ii,  7 

Parametric  algorithms,  i 

Partial  completion,  22 

Partial  pricing,  S3,  57-55 

Penalty  parameter,  p,  4,  33,  35 

PENALTY  PARAMETER,  4,  33 

PH  (Phase),  in  iteration  log,  57-55 

PHANTOM  COLUMNS  and  ELEMENTS,  5, 15,  23 

Piece-wise  smooth  functions,  i,  53 

PILOT  energy-economic  model,  H 

PIVOT,  in  iteration  log,  55 

PIVOT  TOLERANCE,  34,  58,  67 

PP,  in  iteration  log,  57 

Preekel,  P.  V.,  ii 

PRICE  operation,  57 

Primal  simplex  method,  see  simplex  method 

PRINT  file,  6-7,  36 

PRINT  LEVEL  options,  34 

Problem  forms  solved  by  MINOS,  1 

Problem  formulation,  6-6 

PROBLEM  NUMBER,  10,  13,  34 

PUNCH  file,  35,  52,  54 


Quadratic  programming,  ii 
example,  50-61 

Quasi-Newton  method,  i,  2,  3,  6,  27,  55-60 


R,  triangular  matrix  for  approximation  to 
reduced  Hessian,  3,  6,  27,  55-60 
RADIUS  OF  CONVERGENCE,  35 
Ranges  on  general  constraints,  1,  45-46 
RANGES  section  of  MPS  file,  45-46 
RANGES  keyword,  specifying  name  of  range  set,  36 
Ranging  procedures,  i 
READ  file,  6-7 
Record  length  of  files,  6-7 
Reduced  gradient  (vector),  3,  32,  37,  56,  72 
Reduced-gradient  algorithm,  2,  4,  56-60 
Reduced  Hessian  (matrix),  13,  50-60 
Reid,  J.  K.,  i,  U,  2 

Restarting  previous  runs,  46,  55-56,  71 
Restrictions,  in  MPS  format,  46 
on  problem  characteristics,  5-6 
Rewinding  files,  7 
RG,  in  iteration  log,  56 
RHS  section  of  MPS  fils,  45 
RHS  keyword,  specifying  name  of  right-hand  side,  55 
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Right-hand  aids,  1,  4$ 

Robinson,  S.  M.,  i,  I 
Rosen,  J.  B.,  I 

ROW  CHECK,  message  in  PRINT  Ik, 
see  CHECK  FREQUENCY,  33 
ROW  TOLERANCE,  33,  3S,  35 
ROWS  section,  of  MPS  file,  43-43 
of  printed  solution,  70-71 
ROWS,  estimate  of  number  of  general  constraints, 
35 

s,  vector  of  slack  variables,  see  slack  variables 

s,  number  of  super  basic  variables,  2,  5 

S,  matrix  associated  with  super  basic  variables,  3 

Saunders,  M.  A.,  i,  3,  3 

SAVE  FREQUENCY,  31,  33 

Saving  basis  files,  31,  33,  38 

+SBS .  -SBS,  in  iteration  log,  53 

SCALE  options,  38 

Sealing  of  data  and  variables,  5,  38-33 

SCRATCH  file,  3-7 

Search  direction,  3 

Sensitivity  analysis,  i 

Separable  functions,  5 

Sequence  of  problems,  7,  8,  13-18 

Simplex  method,  1-3,  87 

SINF,  in  iteration  log,  83 

Singular  basis,  63,  S3 

Singularities  in  nonlinear  Auctions,  8,  33,  33 
Slack  variables,  1,  15,  33,  70-71 
SLACKS,  in  basis  factorisation  statistics,  31 
Smooth  functions,  1,  5 
Solution  output,  70-73 
example,  108 

SOLUTION  file,  3-7,  38,  73 
SOLUTION  options,  33-37 
Source  files  (MINOS  Fortran  code),  78-31 
Sparse  Jacobian  matrix,  4,  44 
Sparse  constraint  matrix,  4,  18 
SPECS  file,  3-8,  17-40 
checklist  and  default  values,  13-30 
examples,  86,  88,  91,  93,  97, 101 
format,  17-18 
keywords,  31-40 
Spikes,  i 

Standard  form  for  problems,  1 
START  and  STOP  gradient  verification,  17 
State  vector,  H8(*),  14,  80-81,  33 
STEP,  in  iteration  log,  83 
Storage  allocation  and/or  requirements, 
see  workspace 
Structural  variables,  1 
Subproblem,  definition,  4 
Subroutine  hierarchy,  83 
Subroutine  names,  reserved,  77-73 
Subroutines,  required  from  user,  7,  30 
SUBSPACE  TOLERANCE,  37,  30 
SUMMARY  file,  3-7,  38,  73-74 
SUNNARY  FREQUENCY,  30 
Superbasic  variables,  3,  8,  13,  33 
SUPERBASICS  LXNXT,  37,  33 
Suppression  of  output,  34,  38 


SUPPRESS  PARAMETERS  option,  38 
System  information,  6-8,  15-18,  63,  78-33 

Test  problems,  75,  76,  83-34,  88-93,  94-103 
TOO  MANY  ITERATIONS,  exit  condition,  38 
Transformation  of  variables,  8 

U,  in  iteration  log,  58 
UMAX,  in  basis  factorisation  statistics,  33 
UMIN,  in  basis  factorisation  statistics,  33 
Unbounded  problems,  38,  65 
Unconstrained  optimisation,  *"’*r1*i  38-33 
Upper  bounds,  see  bounds 

UPPER  BOUND  (default  upper  bound  on  all  variables), 
38 


VERIFY  options  for  checking  gradients,  33 


Warm  start,  49-83 
WATFTV  compiler.  Hi,  76 
WEAPON,  test  problem,  78,  S3 
WEIGHT  ON  LINEAR  OBJECTIVE,  40 
Wdfe,  P.,  i,  3 

Workspace  (storage  requirements),  5-6, 10,  40,  83, 
68,  69,  79,  80 

WORKSPACE  parameters  in  SPECS  file,  40,  33 
Wright,  M.  R,  ii,  3,  3,  94 
Wylbur  text  editor,  Hi 


x,  nonlinear  variables,  1,  4 
so,  see  initial  point 
*»,  4 

printing,  34 


p,  linear  variables,  1 

Z,  null-space  operator,  3 
Z,  workspace  array,  see  workspace 
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SOL  83-20:  H1N0S  5.0  USER'S  GUIOE,  by  Bruce  A.  Murtagh  and  Michael  A. 
Saunders 


MINOS  is  a  large-scale  optimization  system,  for  the  solution  of  sparse 
linear  and  nonlinear  programs.  The  objective  function  and  constraints  may 
be  linear  or  nonlinear,  or  a  mixture  of  both.  The  nonlinear  functions  must 
be  smooth. 

Stable  numerical  methods  are  employed  throughout.  Features  include  a 
new  basis  package  (for  maintaining  sparse  LU  factors  of  the  basis  matrix), 
automatic  scaling  of  linear  constraints,  and  automatic  estimation  of  some 
or  all  gradients.  Upper  and  lower  bounds  on  the  variables  are  handled 
efficiently.  File  formats  for  constraint  and  basis  data  are  compatible 
with  the  industry  MPS  format. 

The  source  code  is  suitable  for  machines  with  a  Fortran  66  or  77 
compiler  and  at  least  500K  bytes  of  storage. 
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